-- Logs begin at Thu 2022-09-15 12:17:11 UTC, end at Thu 2022-09-15 13:24:37 UTC. -- Sep 15 12:49:58.057955 dv-cinder-836083-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 12:49:58.068711 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 12:49:58.070802 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 12:49:58 2022] *** Sep 15 12:49:58.070802 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 12:49:58.070802 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 12:49:58.070802 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: nodename: dv-cinder-836083-13-iscsi Sep 15 12:49:58.070802 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: machine: x86_64 Sep 15 12:49:58.070802 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: clock source: unix Sep 15 12:49:58.070802 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: pcre jit disabled Sep 15 12:49:58.070802 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: detected number of CPU cores: 4 Sep 15 12:49:58.070802 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: current working directory: / Sep 15 12:49:58.070802 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: detected binary path: /usr/bin/uwsgi-core Sep 15 12:49:58.071516 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: your processes number limit is 47680 Sep 15 12:49:58.071516 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: your memory page size is 4096 bytes Sep 15 12:49:58.071516 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: detected max file descriptor number: 2048 Sep 15 12:49:58.071516 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: lock engine: pthread robust mutexes Sep 15 12:49:58.071516 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: thunder lock: enabled Sep 15 12:49:58.071516 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 12:49:58.071516 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 12:49:58.110621 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: Python main interpreter initialized at 0x56133573c9c0 Sep 15 12:49:58.110621 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: python threads support enabled Sep 15 12:49:58.110621 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: your server socket listen backlog is limited to 100 connections Sep 15 12:49:58.110889 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: your mercy for graceful operations on workers is 90 seconds Sep 15 12:49:58.110965 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 12:49:58.111056 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: *** Operational MODE: preforking *** Sep 15 12:49:58.111300 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: *** uWSGI is running in multiple interpreter mode *** Sep 15 12:49:58.111300 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: spawned uWSGI master process (pid: 105421) Sep 15 12:49:58.111503 dv-cinder-836083-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 12:49:58.112120 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: spawned uWSGI worker 1 (pid: 105422, cores: 1) Sep 15 12:49:58.112420 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: spawned uWSGI worker 2 (pid: 105423, cores: 1) Sep 15 12:49:58.113021 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 12:49:58.768361 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 12:49:58.768967 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 12:49:59.847168 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:49:59.847168 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: from cryptography.utils import int_from_bytes Sep 15 12:49:59.847818 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:49:59.847818 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: from cryptography.utils import int_from_bytes Sep 15 12:49:59.851914 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:49:59.851914 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: from cryptography.utils import int_from_bytes Sep 15 12:49:59.852356 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:49:59.852356 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: from cryptography.utils import int_from_bytes Sep 15 12:50:02.358744 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 12:50:02.359291 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 12:50:02.359414 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 12:50:02.359773 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 12:50:02.360022 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 12:50:02.360430 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.360749 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.361062 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.361372 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.361696 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.361996 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.362305 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.362615 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.362942 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.363196 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.363501 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.363789 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 12:50:02.364139 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-13-iscsi {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.364220 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 12:50:02.364332 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.364424 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.364591 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 12:50:02.364718 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.364953 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 12:50:02.365040 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.365776 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 12:50:02.365885 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.366163 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.366249 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.366459 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.366549 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.366791 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.366945 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.367107 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.368303 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.368550 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.368754 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.368934 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.369135 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.369323 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.369540 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.369728 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.369916 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.370127 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.370290 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.370470 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.370648 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.370860 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.371016 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.371228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-13-iscsi {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.371420 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.371576 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.371756 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.371969 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.371969 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.372353 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-13-iscsi {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.372544 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.372764 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.372927 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.373077 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.373225 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.373387 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.373519 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.373649 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.373649 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.373928 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.374079 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.374202 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.374332 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.374492 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.374617 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.374737 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.374865 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.374986 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.375115 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.375237 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.375357 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.375485 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.375617 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.375956 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.376254 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.376417 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.376541 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.376663 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.376816 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.377021 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.377166 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.377291 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-13-iscsi {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.377423 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.377558 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.377689 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.377815 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.377937 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.378071 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.378200 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.378200 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.378471 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.378622 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.378743 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.378873 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.379001 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.379123 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.379253 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.379382 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.379514 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.379686 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.379812 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.379933 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.380061 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.380183 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.380365 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.380497 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.380627 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.380758 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.380758 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.381001 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.381264 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.381392 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.381514 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.381634 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.381764 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.381895 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.382025 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.382147 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.382274 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.382396 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.382527 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.382661 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.382785 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.382914 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.383044 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.383172 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.383294 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.383423 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.383559 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.383681 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.383681 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.383920 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.384055 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.384186 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.384338 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.384464 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.384595 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.384718 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.384851 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.384982 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.385111 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.385233 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.385360 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.385481 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.385623 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.385747 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.385950 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.386079 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.386366 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.386508 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.386632 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.386753 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.386874 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.387007 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.387130 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.387260 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.387394 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.387522 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.387670 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.387855 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.388006 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.388141 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.388303 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.388444 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.388568 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.388690 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.388690 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.389181 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.389311 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.389439 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.389570 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.389727 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.389858 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.389995 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.390126 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.390248 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.390376 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.390497 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.390626 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.390748 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.390869 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.391002 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.391132 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.391339 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.391479 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.391610 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.391741 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.391863 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.391984 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.392105 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.392236 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.392407 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.392532 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.392653 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.392773 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.392895 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.393025 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.393154 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.393277 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.393406 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.393535 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.393665 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.393797 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.393919 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.394040 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.394161 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.394282 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.394403 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.394532 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.394660 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.394854 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.395013 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.395152 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.395290 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.395414 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.395535 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.395656 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.395775 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.395897 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.396109 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.396234 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.396544 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.396705 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.396830 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.397083 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.397228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.397352 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.397475 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.397597 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.397724 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.397850 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.397981 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.398111 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.398239 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.398369 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.398491 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.398622 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.398745 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.398877 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.399076 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.399201 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.399329 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.399451 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.399582 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.399705 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.399870 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.399998 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.400120 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.400249 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.400404 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.400527 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.400650 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.400770 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.400903 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.401035 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.401173 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.401296 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.401500 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.401632 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.401756 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.401887 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.402037 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.402164 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.402333 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.402459 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.402634 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.402770 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.402949 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.403088 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.403250 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.403377 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.403551 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.403678 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.403848 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.403974 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.404145 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.404335 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.404474 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.404605 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.404757 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.404883 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.405054 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.405180 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.405350 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.405477 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.405645 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.405771 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.405959 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.406162 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.406297 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.406554 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.406682 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.406811 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.406935 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.407065 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.407194 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.407317 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.407444 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:50:02.407566 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.407756 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.407896 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.408086 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.408212 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.408436 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.408561 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.408753 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.408901 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.409054 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.409187 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.409365 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.409567 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.409693 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.409863 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.409998 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.410122 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.410289 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.410415 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.410598 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.410733 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.410900 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.411034 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.411204 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.411331 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.411545 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.411688 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.411813 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.411935 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.413105 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.413238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.413376 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.413507 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.413630 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.413759 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.413882 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.414004 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.414133 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.414265 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.414388 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.414510 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.414632 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.414753 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.414884 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.415012 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.415135 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.415256 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.415378 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.415507 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.415672 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.415801 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.415982 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.416107 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.416337 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.416478 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.416743 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.416865 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.416995 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.417118 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.417239 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.417374 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.417504 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.417627 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.417778 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.417904 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.418080 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.418219 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.418379 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.418506 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.418676 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.418852 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.418977 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.419112 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.419260 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.419389 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.419553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.419707 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.419863 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.420029 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.420182 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.420352 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.420490 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.420616 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.420816 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.420949 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.421103 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.421229 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.421404 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.421530 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.421746 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.421875 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.421997 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.422141 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.422267 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.422453 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.422592 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.422760 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.422887 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.423074 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.423200 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.423382 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.423517 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.423688 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.423815 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.423993 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.424132 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.424318 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.424450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.424620 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.424758 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.424919 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.425051 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.425217 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.425343 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.425510 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.425635 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.425811 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.425935 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.426117 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.426323 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.426454 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.426585 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.426856 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.426994 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.427130 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.427253 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.427375 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.427496 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.427617 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.428436 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.428613 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.428740 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.428871 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.428996 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.429119 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.429255 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.429379 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.429500 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.429655 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.429792 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.429994 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.430135 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.430259 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.430381 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.430544 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.430670 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.430843 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.430979 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.431140 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.431275 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.431441 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.431575 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.431792 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.431923 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.432045 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.432168 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.432313 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.432438 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.432603 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.432731 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.432899 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.433032 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.433219 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.433346 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.433517 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.433652 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.433811 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.433946 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.434105 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.434240 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.434397 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.434531 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.434729 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.434864 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.435025 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.435164 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.435358 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.435484 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.435666 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.435791 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.435965 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.436113 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.436301 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.436519 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.436646 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.436909 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.437038 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.437169 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.437292 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.437421 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.437544 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.437665 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.437786 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.437922 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.438045 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.438167 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.438287 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.438410 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.438590 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.438719 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.438888 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.439016 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.439195 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.439327 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.439496 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.439621 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.439797 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.439922 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.440093 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.440219 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.440382 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.440510 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.440705 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.440833 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.441009 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.441135 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.441347 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.441474 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.441652 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.441784 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.441997 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.442132 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.442256 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.442378 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.442550 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.442684 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.442851 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.442995 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.443157 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.443295 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.443494 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.443679 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.443823 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.443957 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.444082 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.444227 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.444406 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.444571 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.444712 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.444879 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.445007 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.445193 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.445319 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.445500 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.445625 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.445820 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.445948 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.446126 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.446253 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.446441 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.446660 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.446789 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.447050 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.447178 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.447301 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.447430 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.447567 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.447690 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.447813 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.447942 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.448073 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.448238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.448462 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.448588 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.448712 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.448857 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.448992 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.449153 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.449357 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.449483 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.449605 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.449734 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.449864 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.450031 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.450211 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.450345 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.450476 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.450622 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.450749 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.450920 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.451048 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.451225 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.451352 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.451524 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.451651 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.451820 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.452041 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.452181 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.452371 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.452497 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.452620 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.452756 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.452887 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.453011 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.453141 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.453323 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.453459 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.453636 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.453764 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.453932 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.454058 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.454228 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.454363 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.454541 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.454668 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.454840 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.454975 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.455136 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.455273 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.455432 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.455558 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.455725 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.455853 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.456047 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.456185 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.456373 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.456501 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.456704 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.456834 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.457095 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.457227 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.457351 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.457472 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.457594 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.457722 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.457854 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.457978 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.458129 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.458256 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.458426 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.458551 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.458730 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.458855 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.459570 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.459723 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.459999 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.460133 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.460336 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.460465 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.460624 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.460751 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.460926 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.461053 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.461230 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.461365 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.461546 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.461674 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.461847 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.461984 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.462196 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.462336 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.462467 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.462592 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.462715 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.462846 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.463004 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.463129 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.463313 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.463439 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.463611 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.463879 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.464014 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.464205 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.464365 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.464542 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.464679 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.464849 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.464973 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.465155 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.465283 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.465459 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.465596 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.465777 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.465916 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.466084 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.466211 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.466386 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.466518 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.466684 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.466889 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.467022 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.467271 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.467271 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.467513 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.467649 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.467773 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.467901 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.468037 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.468160 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.468304 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.468447 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.468571 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.468716 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.468850 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.469017 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.469143 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.469314 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.469447 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.469611 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.469736 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.469906 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.470197 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.470362 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.470488 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.470608 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.470782 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.470910 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.471084 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.471223 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.471383 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.471510 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.471703 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.471838 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.472004 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.472144 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.472402 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.472526 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.472662 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.472786 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.472908 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.473110 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.473245 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.473369 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.473490 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.473612 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.473812 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.473953 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.474120 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.474246 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.474419 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.474575 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.474917 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.475045 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.475245 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.475378 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.475565 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.475692 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.475864 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.475999 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.476161 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.476321 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.476481 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.476609 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.476783 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.476990 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.477329 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.477466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.477589 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.477710 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.477843 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.477966 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.478089 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.478221 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.478345 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.478481 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.478604 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.478727 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.478856 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.478979 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.479109 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.479245 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.479377 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.479501 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.479623 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.479753 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.479921 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.480057 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.480217 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.480453 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.480582 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.480705 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.480834 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.481012 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.481148 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.481316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.481444 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.481618 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.481754 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.481941 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.482074 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.482240 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.482454 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.482579 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.482709 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.482833 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.482963 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.483087 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.483208 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.483375 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.483516 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.483677 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.483808 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.483970 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.484096 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.484285 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.484426 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.484598 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.484723 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.484893 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.485019 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.485189 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.485322 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.485487 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.485612 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.485782 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.485916 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.486073 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.486199 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.486373 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.486499 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.486667 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.486792 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.487040 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.487192 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.487470 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.487606 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.487732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.487854 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.487986 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.488117 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.488240 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.488390 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.488515 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.488651 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.488785 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.488908 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.489029 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.489151 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.489273 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.489404 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.489549 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.489684 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.489842 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.489969 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.490673 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.490829 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.490985 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.491119 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.491286 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.491413 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.491584 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.491723 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.491881 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.492009 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.492177 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.492350 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.492580 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.492707 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.492830 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.492953 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.493145 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.493278 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.493445 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.493578 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.493750 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.493877 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.494061 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.494186 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.494361 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.494488 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.494659 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.494848 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.494978 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.495100 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.495231 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.495354 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.495523 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.495649 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.495824 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.495958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.496121 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.496248 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.496443 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.496568 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.496738 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.496873 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.497037 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.497243 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.497370 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.497632 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.497632 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.497878 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.498002 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.498124 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.498254 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.498384 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.498513 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.498645 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.498768 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.498890 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.499101 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.499231 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.499399 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.499539 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.499699 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.499824 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.500001 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.500127 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.500327 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.500459 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.500635 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.500802 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.500927 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.501050 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.501247 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.501373 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.501521 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.501647 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.501822 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.501948 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.502121 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.502249 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.502424 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.502633 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.502768 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.502891 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.503022 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.503156 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.503280 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.503404 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.503598 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.503737 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.503895 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.504028 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.504197 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.504337 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.504518 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.504657 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.504823 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.504950 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.505121 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.505248 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.505440 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.505575 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.505744 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.505992 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.506129 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.506262 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.506385 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.506609 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.506744 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.506919 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.507046 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.507296 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.507446 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.507707 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.507839 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.507977 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.508101 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.508223 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.508383 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.508518 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.508650 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.508780 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.508924 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.509059 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.509192 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.509316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.509438 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.509601 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.509736 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.509923 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.510058 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.510227 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.510355 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.510533 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.510660 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.510830 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.510960 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.511110 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.511237 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.511416 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.511543 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.511717 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.511853 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.512017 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.512142 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.512359 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.512504 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.512750 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.512888 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.513049 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.513185 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.513349 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.513482 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.513650 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.513776 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.514211 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.514338 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.514517 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.514652 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.514818 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.514953 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.515196 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.515322 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.515515 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.515651 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.515813 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.515941 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.516118 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.516244 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.516442 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.516584 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.516742 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.516870 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.517047 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.517175 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.517402 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.517545 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.517815 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.517944 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.517944 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.518216 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.518216 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.518455 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.518578 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.518708 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.518830 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.518958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.519131 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.519257 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.519545 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.519670 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.519851 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.519983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.520152 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.520341 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.520479 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.520604 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.520793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.520959 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.521092 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.521217 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.521880 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.522158 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.522362 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.522594 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.522806 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.522945 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.523079 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.523203 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.523327 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.523450 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.523572 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.523702 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.523826 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.523997 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.524124 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.524343 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.524476 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.524655 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.524784 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.524968 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.525107 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.525295 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.525439 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.525575 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.525697 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.525887 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.526021 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.526192 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.526319 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.526509 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.526637 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.526822 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.526955 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.527119 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.527253 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.527513 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.527657 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.527916 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.528048 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.528177 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.528364 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.528492 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.528617 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.528739 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.528861 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.528983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.529115 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.529239 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.529361 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.529510 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.529646 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.529834 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.529970 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.530158 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.530294 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.530460 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.530586 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.530786 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.530923 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.531090 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.531214 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.531378 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.531513 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.531679 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.531814 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.531983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.532108 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.532290 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.532417 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.532604 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.532733 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.532937 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.533072 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.533196 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.533326 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.533457 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.533594 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.533750 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.533878 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.534045 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.534180 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.534342 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.534474 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.534635 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.534762 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.534934 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.535073 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.535226 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.535353 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.535542 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.535669 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.535838 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.535974 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.536154 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.536347 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.536475 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.536598 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.536760 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.536900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.537095 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.537266 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.537457 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.537667 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.537811 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.538066 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.538203 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.538327 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.538455 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.538578 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.538710 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.538845 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.538975 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.539106 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.539271 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.539398 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.539569 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.539702 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.539872 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.539997 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.540157 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.540314 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.540491 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.540617 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.540747 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.540876 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.541055 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.541258 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.541382 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.541504 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.541636 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.541760 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.541921 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.542056 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.542240 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.542367 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.542539 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.542750 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.542877 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.543091 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.543221 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.543367 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.543494 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.543676 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.543804 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.543983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.544117 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.545249 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.545389 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.545510 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.545625 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.545731 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.545836 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.545938 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.546050 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.546050 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.546050 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.546412 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.546541 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.546664 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.546786 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.546909 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.547049 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.547173 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.547295 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.547419 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.547540 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.547827 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.547966 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.548239 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.548386 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.548511 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.548646 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.548784 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.548915 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.549039 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.549168 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.549443 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.549642 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.549779 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.550044 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.550176 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.550300 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.550432 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.550565 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.550689 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.550842 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.550969 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.551190 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.551331 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.551456 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.551578 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.551756 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.551884 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.552060 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.552194 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.552388 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.552529 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.553246 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.553385 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.553553 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.553739 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.553867 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.554103 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.554232 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.554430 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.554567 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.554765 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.554895 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.555082 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.555215 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.555390 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.555594 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.555720 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.555853 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.556003 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.556138 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.556356 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.556544 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.556674 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.556856 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.556986 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.557186 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.557321 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.557508 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.557635 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.557850 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.557982 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.558231 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.558369 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.558494 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.558627 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.558751 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.558886 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.559021 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.559145 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.559305 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.559441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.559591 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.559717 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.559897 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.560112 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.560250 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.560440 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.560564 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.560687 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.560823 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.560948 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.561100 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.561267 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.561399 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.561531 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.561701 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.561962 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.562223 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.562351 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.562566 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.562701 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.562876 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.563002 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.563197 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.563402 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.563528 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.563660 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.563784 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.563907 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.564106 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.564240 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.564440 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.564580 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.564740 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.564866 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.565040 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.565167 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.565343 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.565476 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.565666 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.565796 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.565947 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.566080 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.566245 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.566381 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.566542 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.566667 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.566841 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.566967 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.567139 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.567274 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.567440 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.567661 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.567787 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.568023 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.568167 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.569061 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.569237 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.569367 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.569492 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.569492 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.569735 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.569859 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.569981 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.570104 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.570304 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.570446 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.570572 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.570695 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.570825 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.570949 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.571072 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.571207 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.571372 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.571499 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.571622 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.571745 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.571925 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.572068 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.572226 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.572371 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.572561 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.572689 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.572867 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.572996 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.573166 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.573294 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.573500 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.573637 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.573770 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.573902 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.574063 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.574189 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.574365 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.574491 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.574666 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.574794 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.574965 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.575100 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.575271 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.575397 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.575570 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.575709 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.575869 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.575996 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.576170 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.576351 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.576616 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.576745 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.576924 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.577073 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.577264 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.577402 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.577528 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.577704 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.577839 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.578059 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.578196 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.578329 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.578539 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.578674 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.578798 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.578922 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.579044 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.579206 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.579342 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.579511 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.579638 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.579818 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.579955 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.580120 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.580248 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.580466 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.580603 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.580729 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.580863 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.581028 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.581155 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.581331 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.581499 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.581632 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.581764 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.581919 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.582047 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.582223 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.582525 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.582660 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.582828 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.582959 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.583130 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.583257 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.583432 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.583645 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.583773 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.583915 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.584109 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.584237 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.584453 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.584682 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.584811 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.584941 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.585066 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.585190 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.585359 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.585487 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.585662 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.585790 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.585963 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.586089 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.586268 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.586395 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.586568 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.586695 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.586874 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.587008 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.587197 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.587328 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.587503 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.587637 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.587800 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.587928 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.588174 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.588435 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.588563 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.588775 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.588910 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.589048 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.589173 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.589325 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.589453 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.589636 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.589769 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.589974 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.590111 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.590291 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.590536 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.590674 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.590797 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.590929 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.591060 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.591203 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.591330 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.591518 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.591661 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.591816 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.591943 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.592122 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.592248 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.592455 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.592606 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.592767 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.592895 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.593069 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.593195 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.593370 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.593505 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.593713 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.593846 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.593982 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.594259 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.594403 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.594556 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.594684 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.594854 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.595110 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.595249 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.595382 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.595507 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.595629 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.595753 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.595875 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.596004 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.596137 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.596305 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.596468 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.596596 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.596787 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.596924 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.597093 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.597220 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.597419 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.597547 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.597739 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.597875 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.598036 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.598163 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.598363 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.598499 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.598624 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.598810 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.598944 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.599068 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.599198 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.599329 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.599459 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.599680 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.599879 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.600017 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.600141 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.600291 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.600431 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.600638 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.600765 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.600889 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.601012 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.601142 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.601324 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.601452 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.601618 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.601752 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.601909 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.602037 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.602208 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.602336 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.602511 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.602646 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.602810 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.602937 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.603108 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.603236 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.603406 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.603533 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.603705 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.603923 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.604049 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.604171 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.604351 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.604482 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.604606 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.604746 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.604892 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.605026 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.605242 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.605380 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.605505 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.605636 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.605760 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.605895 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.606049 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.606176 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.606377 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.606513 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.606704 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.606838 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.607011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.607136 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.607324 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.607449 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.607628 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.607752 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.607931 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.608057 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.608240 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.608465 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.608605 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.608729 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.608895 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.609028 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.609161 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.609286 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.609446 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.609573 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.609750 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.609886 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.610058 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.610185 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.610362 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.610489 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.610702 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.610841 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.610966 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.611088 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.611255 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.611384 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.611569 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.611741 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.611889 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.612016 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.612190 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.612475 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.612680 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.612806 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.612928 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.613051 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.613173 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.613296 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.613450 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.613579 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.613763 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.613968 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.614097 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.614220 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.614385 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.614514 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.614686 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.614812 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.614991 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.615714 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.615860 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 12:50:02.615985 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.616116 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.616432 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.616745 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.617054 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.617362 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.617675 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.617986 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.618311 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.618635 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.618941 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.619266 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.619590 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.619933 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.620241 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.620605 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.620931 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.621245 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.621553 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.621852 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:50:02.622090 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 12:50:02.769638 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO dbcounter [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Registered counter for database nova_api Sep 15 12:50:02.775741 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO dbcounter [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] Registered counter for database nova_api Sep 15 12:50:02.790064 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_db.sqlalchemy.engines [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:50:02.795501 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_db.sqlalchemy.engines [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:50:02.796644 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writer thread running {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:50:02.801826 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writer thread running {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:50:02.853629 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.context [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6795f125-b3e5-4c74-8d4a-d8548f3dc3a0(cell1) {{(pid=105423) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 12:50:02.857518 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:50:02.857987 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:50:02.859597 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:50:02.860298 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:50:02.860743 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:50:02.861926 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.context [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6795f125-b3e5-4c74-8d4a-d8548f3dc3a0(cell1) {{(pid=105422) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 12:50:02.862699 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:50:02.864716 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO dbcounter [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Registered counter for database nova_cell0 Sep 15 12:50:02.867125 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:50:02.867596 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:50:02.869188 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:50:02.869379 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO dbcounter [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Registered counter for database nova_cell1 Sep 15 12:50:02.869912 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:50:02.870354 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:50:02.872352 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_concurrency.lockutils [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:50:02.874357 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO dbcounter [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] Registered counter for database nova_cell0 Sep 15 12:50:02.877089 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_db.sqlalchemy.engines [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:50:02.878463 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO dbcounter [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] Registered counter for database nova_cell1 Sep 15 12:50:02.879128 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_db.sqlalchemy.engines [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:50:02.884845 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writer thread running {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:50:02.886150 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_db.sqlalchemy.engines [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:50:02.888204 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writer thread running {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:50:02.889415 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_db.sqlalchemy.engines [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:50:02.892726 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writer thread running {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:50:03.030927 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writer thread running {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:50:03.031813 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO dbcounter [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Registered counter for database nova_cell0 Sep 15 12:50:03.041384 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_db.sqlalchemy.engines [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:50:03.041671 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO dbcounter [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] Registered counter for database nova_cell0 Sep 15 12:50:03.045780 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writer thread running {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:50:03.050191 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG oslo_db.sqlalchemy.engines [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:50:03.055564 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writer thread running {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:50:03.385842 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: WARNING keystonemiddleware.auth_token [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:50:03.390465 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: WARNING keystonemiddleware.auth_token [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:50:03.393359 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: WARNING keystonemiddleware.auth_token [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:50:03.398586 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: WARNING keystonemiddleware.auth_token [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:50:03.738890 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: WARNING keystonemiddleware.auth_token [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:50:03.744926 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: WARNING keystonemiddleware.auth_token [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:50:03.748796 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: WARNING keystonemiddleware.auth_token [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:50:03.750192 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56133573c9c0 pid: 105423 (default app) Sep 15 12:50:03.752236 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:50:03.753448 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001748 Sep 15 12:50:03.753858 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Thu Sep 15 12:50:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:50:03.754674 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: WARNING keystonemiddleware.auth_token [None req-9e98d9ea-49dc-4c97-a6e0-05f122bcdec8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:50:03.760905 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56133573c9c0 pid: 105422 (default app) Sep 15 12:51:26.006229 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:51:26.007234 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 15 12:51:26.007619 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 931 bytes} [Thu Sep 15 12:51:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:51:26.019929 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_api:SELECT=3 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:26.021683 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_cell0:SELECT=3 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:26.022663 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_cell1:SELECT=3 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:26.024777 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:26.916407 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-08925d73-e2cd-42df-a1ba-e7d5996fd58a admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:51:26.950414 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-08925d73-e2cd-42df-a1ba-e7d5996fd58a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.936167 Sep 15 12:51:26.951177 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1292 bytes} [Thu Sep 15 12:51:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:51:29.624865 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:51:29.626085 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-d99f1051-80e6-4a8d-8f45-8fc46c7fe69f None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 15 12:51:29.628615 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 931 bytes} [Thu Sep 15 12:51:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:51:30.084573 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-cb69f18f-5fbd-43bf-bf01-cbd7e56b8861 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:30.132173 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-cb69f18f-5fbd-43bf-bf01-cbd7e56b8861 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.499487 Sep 15 12:51:30.132756 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1283 bytes} [Thu Sep 15 12:51:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:51:30.147477 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_api:SELECT=3 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:30.148335 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_cell1:SELECT=3 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:30.150239 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_cell0:SELECT=3 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:30.151011 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:30.358580 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-2b6f1221-d830-4012-94d2-976dc811ebf2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:30.429535 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-2b6f1221-d830-4012-94d2-976dc811ebf2 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287996 Sep 15 12:51:30.430415 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1336 bytes} [Thu Sep 15 12:51:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:51:33.084337 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-cb69f18f-5fbd-43bf-bf01-cbd7e56b8861 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:51:33.086127 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-cb69f18f-5fbd-43bf-bf01-cbd7e56b8861 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002484 Sep 15 12:51:33.086997 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 931 bytes} [Thu Sep 15 12:51:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:51:33.743176 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-ed572b5b-7004-41eb-9436-13a74f9566cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "id": "d1"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:33.783849 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-ed572b5b-7004-41eb-9436-13a74f9566cb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.687155 Sep 15 12:51:33.788017 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1283 bytes} [Thu Sep 15 12:51:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:51:33.797224 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-0b555404-1ba2-467f-91ae-54b50ecd2a4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:33.839421 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-0b555404-1ba2-467f-91ae-54b50ecd2a4c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045846 Sep 15 12:51:33.840326 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1336 bytes} [Thu Sep 15 12:51:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:51:36.488477 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-ed572b5b-7004-41eb-9436-13a74f9566cb admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:51:36.489523 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-ed572b5b-7004-41eb-9436-13a74f9566cb admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Sep 15 12:51:36.489947 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 931 bytes} [Thu Sep 15 12:51:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:51:36.918102 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-96de0b19-a0b3-4926-b62a-c0ab5453b250 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "id": "d2"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:36.937802 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-96de0b19-a0b3-4926-b62a-c0ab5453b250 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440871 Sep 15 12:51:36.938385 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1283 bytes} [Thu Sep 15 12:51:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 12:51:36.950756 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-27f89a95-48df-43c9-a583-7cc2bf7782a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:36.981254 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-27f89a95-48df-43c9-a583-7cc2bf7782a3 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034047 Sep 15 12:51:36.981836 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1336 bytes} [Thu Sep 15 12:51:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:51:39.660256 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-96de0b19-a0b3-4926-b62a-c0ab5453b250 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:51:39.661623 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-96de0b19-a0b3-4926-b62a-c0ab5453b250 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001873 Sep 15 12:51:39.662036 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 931 bytes} [Thu Sep 15 12:51:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:51:40.083486 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-d706f61d-7264-47ac-ada3-4c9ed374147e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:40.116071 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-d706f61d-7264-47ac-ada3-4c9ed374147e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447997 Sep 15 12:51:40.116778 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1283 bytes} [Thu Sep 15 12:51:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 12:51:40.129757 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-bef3d5f1-b03a-47a3-b55b-0b9d214fe76c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:40.159356 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-bef3d5f1-b03a-47a3-b55b-0b9d214fe76c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033940 Sep 15 12:51:40.160111 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1336 bytes} [Thu Sep 15 12:51:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:51:42.867281 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-d706f61d-7264-47ac-ada3-4c9ed374147e admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:51:42.868709 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-d706f61d-7264-47ac-ada3-4c9ed374147e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002001 Sep 15 12:51:42.869416 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 931 bytes} [Thu Sep 15 12:51:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:51:43.306365 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-c5ed5381-04fa-4819-bb6f-b42768d01823 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "ram": 4096}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:43.328927 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-c5ed5381-04fa-4819-bb6f-b42768d01823 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.453030 Sep 15 12:51:43.330106 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1283 bytes} [Thu Sep 15 12:51:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:51:43.345830 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-41d7fbd8-4ae7-4f20-b022-2b4b450f224b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:43.376973 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-41d7fbd8-4ae7-4f20-b022-2b4b450f224b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035808 Sep 15 12:51:43.377562 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1336 bytes} [Thu Sep 15 12:51:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:51:45.988862 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-c5ed5381-04fa-4819-bb6f-b42768d01823 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:51:45.989880 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-c5ed5381-04fa-4819-bb6f-b42768d01823 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Sep 15 12:51:45.990276 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 931 bytes} [Thu Sep 15 12:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:51:46.413151 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-70718f3b-b604-49a0-92a3-f5a8d2892ae9 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:51:46.438413 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-70718f3b-b604-49a0-92a3-f5a8d2892ae9 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.441990 Sep 15 12:51:46.438960 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1292 bytes} [Thu Sep 15 12:51:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:51:49.399228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-c5ed5381-04fa-4819-bb6f-b42768d01823 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:51:49.404664 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-c5ed5381-04fa-4819-bb6f-b42768d01823 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 15 12:51:49.405243 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 931 bytes} [Thu Sep 15 12:51:49 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:51:49.803793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-c40dfa4a-28ed-46ac-b526-c1418c3e5616 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:49.824512 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-c40dfa4a-28ed-46ac-b526-c1418c3e5616 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.412476 Sep 15 12:51:49.825063 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1283 bytes} [Thu Sep 15 12:51:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:51:49.837680 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-3bb6a251-4684-4b28-9417-808f078a8c30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:49.865672 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-3bb6a251-4684-4b28-9417-808f078a8c30 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031684 Sep 15 12:51:49.866248 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1333 bytes} [Thu Sep 15 12:51:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:51:52.475124 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-c40dfa4a-28ed-46ac-b526-c1418c3e5616 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:51:52.476389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-c40dfa4a-28ed-46ac-b526-c1418c3e5616 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Sep 15 12:51:52.476786 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 931 bytes} [Thu Sep 15 12:51:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:51:52.844790 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-93931e8c-29eb-42b3-817c-83962a96b7b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "id": "2", "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:52.865040 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-93931e8c-29eb-42b3-817c-83962a96b7b8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.381977 Sep 15 12:51:52.865711 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1283 bytes} [Thu Sep 15 12:51:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:51:52.877597 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-c3f1e671-83ef-47f4-a4f0-6cab4c692614 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:52.903502 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-c3f1e671-83ef-47f4-a4f0-6cab4c692614 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029562 Sep 15 12:51:52.904090 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1333 bytes} [Thu Sep 15 12:51:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:51:55.537722 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-93931e8c-29eb-42b3-817c-83962a96b7b8 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:51:55.538819 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-93931e8c-29eb-42b3-817c-83962a96b7b8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Sep 15 12:51:55.539387 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 931 bytes} [Thu Sep 15 12:51:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:51:56.078949 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-b2a5b969-0c94-433a-aad1-da9dc8d16754 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "swap": 0, "ram": 4096, "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:56.107138 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-b2a5b969-0c94-433a-aad1-da9dc8d16754 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.561683 Sep 15 12:51:56.107987 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1283 bytes} [Thu Sep 15 12:51:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 12:51:56.120162 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-7f37cf6f-e1cb-47c2-8757-3fec3428dbb2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:56.124920 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:56.152233 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-7f37cf6f-e1cb-47c2-8757-3fec3428dbb2 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035568 Sep 15 12:51:56.153271 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1333 bytes} [Thu Sep 15 12:51:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:51:58.808943 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-b2a5b969-0c94-433a-aad1-da9dc8d16754 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:51:58.809948 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-b2a5b969-0c94-433a-aad1-da9dc8d16754 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 15 12:51:58.810352 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 931 bytes} [Thu Sep 15 12:51:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:51:59.267692 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-362aab0a-6044-41c3-bc82-1b84091da271 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "name": "m1.large"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:59.291680 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-362aab0a-6044-41c3-bc82-1b84091da271 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.474714 Sep 15 12:51:59.292749 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1283 bytes} [Thu Sep 15 12:51:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:51:59.304417 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-ee930fa5-f487-4868-9f2a-29af0c531ee6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:51:59.330425 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-ee930fa5-f487-4868-9f2a-29af0c531ee6 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029726 Sep 15 12:51:59.332139 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1333 bytes} [Thu Sep 15 12:51:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:52:01.980614 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-362aab0a-6044-41c3-bc82-1b84091da271 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:01.982197 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-362aab0a-6044-41c3-bc82-1b84091da271 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Sep 15 12:52:01.982590 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 931 bytes} [Thu Sep 15 12:52:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:52:02.437919 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-5a428aa9-409c-4b84-b11a-ff45e9891d43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:52:02.444660 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:02.459125 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-5a428aa9-409c-4b84-b11a-ff45e9891d43 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.470121 Sep 15 12:52:02.459686 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1283 bytes} [Thu Sep 15 12:52:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:52:02.472563 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-8549f572-b69d-40a1-a909-af935e8e01a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:52:02.501171 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-8549f572-b69d-40a1-a909-af935e8e01a7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032856 Sep 15 12:52:02.501757 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1333 bytes} [Thu Sep 15 12:52:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:52:19.298329 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-5a428aa9-409c-4b84-b11a-ff45e9891d43 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:19.299338 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-5a428aa9-409c-4b84-b11a-ff45e9891d43 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 15 12:52:19.299744 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 931 bytes} [Thu Sep 15 12:52:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:52:19.310851 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:19.696114 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-ee357c50-36f5-4bcc-a653-56e6afce1a1c admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:19.714391 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-ee357c50-36f5-4bcc-a653-56e6afce1a1c admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407831 Sep 15 12:52:19.714855 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1292 bytes} [Thu Sep 15 12:52:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:52:21.026301 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-5a428aa9-409c-4b84-b11a-ff45e9891d43 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:21.027340 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-5a428aa9-409c-4b84-b11a-ff45e9891d43 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Sep 15 12:52:21.027736 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Sep 15 12:52:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:52:21.548373 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-edc987c2-045c-42a2-9bf2-155286221270 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:21.554308 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.wsgi [None req-edc987c2-045c-42a2-9bf2-155286221270 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-edc987c2-045c-42a2-9bf2-155286221270 admin admin] Request method failure captured: Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Accept: application/json Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Accept-Encoding: gzip, deflate Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Connection: keep-alive Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Content-Length: 0 Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Host: 10.222.0.57 Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Openstack-Api-Version: compute 2.92 Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Openstack-System-Scope: None Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: User-Agent: python-novaclient Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Auth-Token: gAAAAABjIyAE0LrBmOSkCGPAVHlDKMOv10aaeB-oP0KZ-dNP-7WWAB9iZjUs07BzOIGk7JObMxUG1mHGVGVPatQSLMb64g8qUe4kH2cK7PTFUmZgfpL0s-mFX7N3GT-1mCwK5IesTIBUarnikuj5QrFSgLUaz6wXyuzdriomF5Y1Kq4m3p5_2Gg Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Domain-Id: None Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Domain-Name: None Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Identity-Status: Confirmed Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Is-Admin-Project: True Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Project-Domain-Id: default Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Project-Domain-Name: Default Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Project-Id: 53ac1f185c9948448574c644790cea74 Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Project-Name: admin Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Role: member,admin,reader Sep 15 12:52:21.557597 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Roles: member,admin,reader Sep 15 12:52:21.559228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_53ac1f185c9948448574c644790cea74", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/53ac1f185c9948448574c644790cea74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/53ac1f185c9948448574c644790cea74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/53ac1f185c9948448574c644790cea74"}]}] Sep 15 12:52:21.559228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Tenant: admin Sep 15 12:52:21.559228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Tenant-Id: 53ac1f185c9948448574c644790cea74 Sep 15 12:52:21.559228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Tenant-Name: admin Sep 15 12:52:21.559228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User: admin Sep 15 12:52:21.559228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User-Domain-Id: default Sep 15 12:52:21.559228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User-Domain-Name: Default Sep 15 12:52:21.559228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User-Id: 07cb4dfbc4ad477d912360d9e55fab21 Sep 15 12:52:21.559228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User-Name: admin Sep 15 12:52:21.559228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: method: > Sep 15 12:52:21.559228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: exception: Flavor 42 could not be found. Sep 15 12:52:21.559228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: action_args: {'id': '42'} Sep 15 12:52:21.559228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:52:21.559228 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:52:21.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:21.561441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-edc987c2-045c-42a2-9bf2-155286221270 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:52:21.562506 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-edc987c2-045c-42a2-9bf2-155286221270 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392388 Sep 15 12:52:21.562506 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Sep 15 12:52:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:21.570317 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-a83f3f52-10a9-4728-bf79-b86d54844895 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:21.592117 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-a83f3f52-10a9-4728-bf79-b86d54844895 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026961 Sep 15 12:52:21.592671 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Sep 15 12:52:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:52:21.603172 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-bd3591c8-dd11-4e8b-870e-16615d6e01b1 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:21.624817 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-bd3591c8-dd11-4e8b-870e-16615d6e01b1 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026043 Sep 15 12:52:21.625363 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Sep 15 12:52:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:52:21.635707 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-dd7495b4-03f3-4d3a-b1a3-ee7bd6de140f admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:21.641310 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.wsgi [None req-dd7495b4-03f3-4d3a-b1a3-ee7bd6de140f admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-dd7495b4-03f3-4d3a-b1a3-ee7bd6de140f admin admin] Request method failure captured: Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Accept: application/json Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Accept-Encoding: gzip, deflate Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Connection: keep-alive Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Content-Length: 0 Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Host: 10.222.0.57 Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Openstack-Api-Version: compute 2.92 Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Openstack-System-Scope: None Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: User-Agent: python-novaclient Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Auth-Token: gAAAAABjIyAE0LrBmOSkCGPAVHlDKMOv10aaeB-oP0KZ-dNP-7WWAB9iZjUs07BzOIGk7JObMxUG1mHGVGVPatQSLMb64g8qUe4kH2cK7PTFUmZgfpL0s-mFX7N3GT-1mCwK5IesTIBUarnikuj5QrFSgLUaz6wXyuzdriomF5Y1Kq4m3p5_2Gg Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Domain-Id: None Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Domain-Name: None Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Identity-Status: Confirmed Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Is-Admin-Project: True Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Project-Domain-Id: default Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Project-Domain-Name: Default Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Project-Id: 53ac1f185c9948448574c644790cea74 Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Project-Name: admin Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Role: member,admin,reader Sep 15 12:52:21.645238 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Roles: member,admin,reader Sep 15 12:52:21.646732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_53ac1f185c9948448574c644790cea74", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/53ac1f185c9948448574c644790cea74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/53ac1f185c9948448574c644790cea74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/53ac1f185c9948448574c644790cea74"}]}] Sep 15 12:52:21.646732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Tenant: admin Sep 15 12:52:21.646732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Tenant-Id: 53ac1f185c9948448574c644790cea74 Sep 15 12:52:21.646732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Tenant-Name: admin Sep 15 12:52:21.646732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User: admin Sep 15 12:52:21.646732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User-Domain-Id: default Sep 15 12:52:21.646732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User-Domain-Name: Default Sep 15 12:52:21.646732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User-Id: 07cb4dfbc4ad477d912360d9e55fab21 Sep 15 12:52:21.646732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User-Name: admin Sep 15 12:52:21.646732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: method: > Sep 15 12:52:21.646732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: exception: Flavor 42 could not be found. Sep 15 12:52:21.646732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: action_args: {'id': '42'} Sep 15 12:52:21.646732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:52:21.646732 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:52:21.647700 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:21.648835 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-dd7495b4-03f3-4d3a-b1a3-ee7bd6de140f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:52:21.649808 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-dd7495b4-03f3-4d3a-b1a3-ee7bd6de140f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014491 Sep 15 12:52:21.649808 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Sep 15 12:52:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:22.871133 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-bd3591c8-dd11-4e8b-870e-16615d6e01b1 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:22.872138 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-bd3591c8-dd11-4e8b-870e-16615d6e01b1 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 15 12:52:22.872576 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Sep 15 12:52:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:52:23.398082 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-b1705877-5f06-4645-9a5a-374eec766078 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:23.403033 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.wsgi [None req-b1705877-5f06-4645-9a5a-374eec766078 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-b1705877-5f06-4645-9a5a-374eec766078 admin admin] Request method failure captured: Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Accept: application/json Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Accept-Encoding: gzip, deflate Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Connection: keep-alive Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Content-Length: 0 Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Host: 10.222.0.57 Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Openstack-Api-Version: compute 2.92 Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Openstack-System-Scope: None Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: User-Agent: python-novaclient Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Auth-Token: gAAAAABjIyAG0PRx9Y8qNMKmSEEG08L9hHarkaybS3Hq3NZrr71mN8coL5oxHaiMabC_xyGqL2zje3iGu72TtddHHmmTyO4ZbFFhI-w9pAl0k9aNhBpL16he0JvJupBhmDSmPUNeWfrTR-7QskZRgjsE6Bp7te9mjq1HSNMEuVOs-JL7auYOavM Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Domain-Id: None Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Domain-Name: None Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Identity-Status: Confirmed Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Is-Admin-Project: True Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Project-Domain-Id: default Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Project-Domain-Name: Default Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Project-Id: 53ac1f185c9948448574c644790cea74 Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Project-Name: admin Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Role: member,admin,reader Sep 15 12:52:23.404555 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Roles: member,admin,reader Sep 15 12:52:23.406020 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_53ac1f185c9948448574c644790cea74", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/53ac1f185c9948448574c644790cea74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/53ac1f185c9948448574c644790cea74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/53ac1f185c9948448574c644790cea74"}]}] Sep 15 12:52:23.406020 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Tenant: admin Sep 15 12:52:23.406020 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Tenant-Id: 53ac1f185c9948448574c644790cea74 Sep 15 12:52:23.406020 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Tenant-Name: admin Sep 15 12:52:23.406020 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User: admin Sep 15 12:52:23.406020 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User-Domain-Id: default Sep 15 12:52:23.406020 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User-Domain-Name: Default Sep 15 12:52:23.406020 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User-Id: 07cb4dfbc4ad477d912360d9e55fab21 Sep 15 12:52:23.406020 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User-Name: admin Sep 15 12:52:23.406020 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: method: > Sep 15 12:52:23.406020 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: exception: Flavor 84 could not be found. Sep 15 12:52:23.406020 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: action_args: {'id': '84'} Sep 15 12:52:23.406020 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:52:23.406020 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:52:23.408958 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:23.410450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-b1705877-5f06-4645-9a5a-374eec766078 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:52:23.411746 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-b1705877-5f06-4645-9a5a-374eec766078 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.394669 Sep 15 12:52:23.411746 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Sep 15 12:52:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:23.415645 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-6c9f757a-dce4-4463-85bd-64d8aac3ca8e admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:23.431118 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-6c9f757a-dce4-4463-85bd-64d8aac3ca8e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019025 Sep 15 12:52:23.431634 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Sep 15 12:52:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:52:23.440811 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-d411662a-dd54-4d1e-ac21-75d94fa2d8f9 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:23.456435 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-d411662a-dd54-4d1e-ac21-75d94fa2d8f9 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019118 Sep 15 12:52:23.457281 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Sep 15 12:52:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:52:23.466320 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-950f0abe-8d7b-4765-8558-d73faedee0c0 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:23.471258 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.wsgi [None req-950f0abe-8d7b-4765-8558-d73faedee0c0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-950f0abe-8d7b-4765-8558-d73faedee0c0 admin admin] Request method failure captured: Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Accept: application/json Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Accept-Encoding: gzip, deflate Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Connection: keep-alive Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Content-Length: 0 Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Host: 10.222.0.57 Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Openstack-Api-Version: compute 2.92 Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Openstack-System-Scope: None Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: User-Agent: python-novaclient Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Auth-Token: gAAAAABjIyAG0PRx9Y8qNMKmSEEG08L9hHarkaybS3Hq3NZrr71mN8coL5oxHaiMabC_xyGqL2zje3iGu72TtddHHmmTyO4ZbFFhI-w9pAl0k9aNhBpL16he0JvJupBhmDSmPUNeWfrTR-7QskZRgjsE6Bp7te9mjq1HSNMEuVOs-JL7auYOavM Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Domain-Id: None Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Domain-Name: None Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Identity-Status: Confirmed Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Is-Admin-Project: True Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Project-Domain-Id: default Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Project-Domain-Name: Default Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Project-Id: 53ac1f185c9948448574c644790cea74 Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Project-Name: admin Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Role: member,admin,reader Sep 15 12:52:23.473212 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Roles: member,admin,reader Sep 15 12:52:23.474952 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_53ac1f185c9948448574c644790cea74", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/53ac1f185c9948448574c644790cea74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/53ac1f185c9948448574c644790cea74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/53ac1f185c9948448574c644790cea74"}]}] Sep 15 12:52:23.474952 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Tenant: admin Sep 15 12:52:23.474952 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Tenant-Id: 53ac1f185c9948448574c644790cea74 Sep 15 12:52:23.474952 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Tenant-Name: admin Sep 15 12:52:23.474952 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User: admin Sep 15 12:52:23.474952 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User-Domain-Id: default Sep 15 12:52:23.474952 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User-Domain-Name: Default Sep 15 12:52:23.474952 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User-Id: 07cb4dfbc4ad477d912360d9e55fab21 Sep 15 12:52:23.474952 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User-Name: admin Sep 15 12:52:23.474952 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: method: > Sep 15 12:52:23.474952 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: exception: Flavor 84 could not be found. Sep 15 12:52:23.474952 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: action_args: {'id': '84'} Sep 15 12:52:23.474952 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:52:23.474952 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:52:23.475900 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:23.477316 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-950f0abe-8d7b-4765-8558-d73faedee0c0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:52:23.478568 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-950f0abe-8d7b-4765-8558-d73faedee0c0 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011695 Sep 15 12:52:23.478568 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Sep 15 12:52:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 15 12:52:24.706212 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-d411662a-dd54-4d1e-ac21-75d94fa2d8f9 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:24.707281 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-d411662a-dd54-4d1e-ac21-75d94fa2d8f9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001841 Sep 15 12:52:24.707669 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Sep 15 12:52:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:52:25.225761 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-c3879482-7df0-4286-a3b6-c456e613890b admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:25.231494 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.wsgi [None req-c3879482-7df0-4286-a3b6-c456e613890b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-c3879482-7df0-4286-a3b6-c456e613890b admin admin] Request method failure captured: Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Accept: application/json Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Accept-Encoding: gzip, deflate Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Connection: keep-alive Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Content-Length: 0 Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Host: 10.222.0.57 Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Openstack-Api-Version: compute 2.92 Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Openstack-System-Scope: None Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: User-Agent: python-novaclient Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Auth-Token: gAAAAABjIyAIPpGmHcvDAuorf5O6yvVF8kZvFKpN0onQPXFE9YhtC_VMqmENdFZzDx8Qm6D5nrqexT8Do0cUHe3J8Fhvwc6ALrZzH-G_2e9WmSjRO1ueUkFUwJC7RTvc-Z3teDthWoWjEsEhyT8mKEy1moP0nYZ-2osbQTXwm4LHM55M-DkqfIg Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Domain-Id: None Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Domain-Name: None Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Identity-Status: Confirmed Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Is-Admin-Project: True Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Project-Domain-Id: default Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Project-Domain-Name: Default Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Project-Id: 53ac1f185c9948448574c644790cea74 Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Project-Name: admin Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Role: member,admin,reader Sep 15 12:52:25.233011 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Roles: member,admin,reader Sep 15 12:52:25.234466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_53ac1f185c9948448574c644790cea74", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/53ac1f185c9948448574c644790cea74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/53ac1f185c9948448574c644790cea74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/53ac1f185c9948448574c644790cea74"}]}] Sep 15 12:52:25.234466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Tenant: admin Sep 15 12:52:25.234466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Tenant-Id: 53ac1f185c9948448574c644790cea74 Sep 15 12:52:25.234466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-Tenant-Name: admin Sep 15 12:52:25.234466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User: admin Sep 15 12:52:25.234466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User-Domain-Id: default Sep 15 12:52:25.234466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User-Domain-Name: Default Sep 15 12:52:25.234466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User-Id: 07cb4dfbc4ad477d912360d9e55fab21 Sep 15 12:52:25.234466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: X-User-Name: admin Sep 15 12:52:25.234466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: method: > Sep 15 12:52:25.234466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: exception: Flavor 451 could not be found. Sep 15 12:52:25.234466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: action_args: {'id': '451'} Sep 15 12:52:25.234466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:52:25.234466 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:52:25.235299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: ERROR nova.api.openstack.wsgi Sep 15 12:52:25.236607 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-c3879482-7df0-4286-a3b6-c456e613890b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:52:25.237827 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-c3879482-7df0-4286-a3b6-c456e613890b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388658 Sep 15 12:52:25.237827 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Sep 15 12:52:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:25.244461 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-dbbb22ab-8acb-4bfd-9f25-5dcb2fc40245 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:25.259687 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-dbbb22ab-8acb-4bfd-9f25-5dcb2fc40245 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018697 Sep 15 12:52:25.260206 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Sep 15 12:52:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:52:25.270160 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-eff29936-4b32-47a5-9366-aee3abed6165 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:25.284592 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-eff29936-4b32-47a5-9366-aee3abed6165 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018460 Sep 15 12:52:25.285119 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Sep 15 12:52:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:52:25.294284 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-6b4d54c2-657b-49d1-aaa9-71b37f699eb2 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:25.299163 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.wsgi [None req-6b4d54c2-657b-49d1-aaa9-71b37f699eb2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-6b4d54c2-657b-49d1-aaa9-71b37f699eb2 admin admin] Request method failure captured: Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Accept: application/json Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Accept-Encoding: gzip, deflate Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Connection: keep-alive Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Content-Length: 0 Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Host: 10.222.0.57 Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Openstack-Api-Version: compute 2.92 Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Openstack-System-Scope: None Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: User-Agent: python-novaclient Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Auth-Token: gAAAAABjIyAIPpGmHcvDAuorf5O6yvVF8kZvFKpN0onQPXFE9YhtC_VMqmENdFZzDx8Qm6D5nrqexT8Do0cUHe3J8Fhvwc6ALrZzH-G_2e9WmSjRO1ueUkFUwJC7RTvc-Z3teDthWoWjEsEhyT8mKEy1moP0nYZ-2osbQTXwm4LHM55M-DkqfIg Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Domain-Id: None Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Domain-Name: None Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Identity-Status: Confirmed Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Is-Admin-Project: True Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Project-Domain-Id: default Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Project-Domain-Name: Default Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Project-Id: 53ac1f185c9948448574c644790cea74 Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Project-Name: admin Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Role: member,admin,reader Sep 15 12:52:25.300983 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Roles: member,admin,reader Sep 15 12:52:25.302553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_53ac1f185c9948448574c644790cea74", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/53ac1f185c9948448574c644790cea74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/53ac1f185c9948448574c644790cea74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/53ac1f185c9948448574c644790cea74"}]}] Sep 15 12:52:25.302553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Tenant: admin Sep 15 12:52:25.302553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Tenant-Id: 53ac1f185c9948448574c644790cea74 Sep 15 12:52:25.302553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-Tenant-Name: admin Sep 15 12:52:25.302553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User: admin Sep 15 12:52:25.302553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User-Domain-Id: default Sep 15 12:52:25.302553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User-Domain-Name: Default Sep 15 12:52:25.302553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User-Id: 07cb4dfbc4ad477d912360d9e55fab21 Sep 15 12:52:25.302553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: X-User-Name: admin Sep 15 12:52:25.302553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: method: > Sep 15 12:52:25.302553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: exception: Flavor 451 could not be found. Sep 15 12:52:25.302553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: action_args: {'id': '451'} Sep 15 12:52:25.302553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:52:25.302553 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:52:25.303389 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: ERROR nova.api.openstack.wsgi Sep 15 12:52:25.304793 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-6b4d54c2-657b-49d1-aaa9-71b37f699eb2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:52:25.306011 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-6b4d54c2-657b-49d1-aaa9-71b37f699eb2 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011652 Sep 15 12:52:25.306011 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Sep 15 12:52:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 15 12:52:26.528046 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-eff29936-4b32-47a5-9366-aee3abed6165 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:26.529082 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-eff29936-4b32-47a5-9366-aee3abed6165 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 15 12:52:26.529475 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Sep 15 12:52:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:52:27.071595 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-97cdc2c1-d963-48bb-86e1-a52e8bd01767 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:52:27.092543 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-97cdc2c1-d963-48bb-86e1-a52e8bd01767 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.425502 Sep 15 12:52:27.093088 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Sep 15 12:52:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:52:28.404204 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-eff29936-4b32-47a5-9366-aee3abed6165 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:28.405324 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-eff29936-4b32-47a5-9366-aee3abed6165 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Sep 15 12:52:28.407006 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Sep 15 12:52:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:52:28.970805 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-f97de6aa-4c1a-4bac-bba9-59a4ee6596f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:52:28.989459 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-f97de6aa-4c1a-4bac-bba9-59a4ee6596f3 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.415374 Sep 15 12:52:28.990008 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Sep 15 12:52:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:52:30.215246 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-eff29936-4b32-47a5-9366-aee3abed6165 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:30.216240 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-eff29936-4b32-47a5-9366-aee3abed6165 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Sep 15 12:52:30.216657 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Sep 15 12:52:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:52:30.738433 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-6d97d44d-bb41-4213-a15d-221964732755 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:52:30.756885 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-6d97d44d-bb41-4213-a15d-221964732755 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.404452 Sep 15 12:52:30.757424 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Sep 15 12:52:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 12:52:31.987361 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-eff29936-4b32-47a5-9366-aee3abed6165 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:31.988923 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-eff29936-4b32-47a5-9366-aee3abed6165 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002011 Sep 15 12:52:31.989310 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Sep 15 12:52:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:52:32.510032 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-29f08cf7-0690-41a6-a4bf-e4021c222c68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:52:32.528964 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-29f08cf7-0690-41a6-a4bf-e4021c222c68 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.400799 Sep 15 12:52:32.529511 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Sep 15 12:52:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:52:33.747788 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-eff29936-4b32-47a5-9366-aee3abed6165 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:33.748824 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-eff29936-4b32-47a5-9366-aee3abed6165 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 15 12:52:33.749234 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Sep 15 12:52:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:52:34.271864 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-f7053cfa-2729-469a-8550-bea161b0d4a2 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:52:34.296554 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-f7053cfa-2729-469a-8550-bea161b0d4a2 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.409383 Sep 15 12:52:34.297092 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Thu Sep 15 12:52:33 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:53:31.342441 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-eff29936-4b32-47a5-9366-aee3abed6165 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:53:31.343447 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-eff29936-4b32-47a5-9366-aee3abed6165 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 15 12:53:31.343838 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 931 bytes} [Thu Sep 15 12:53:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:53:31.354463 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:31.739174 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-5d504280-d68c-4406-9cc1-28e1c49829f5 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:53:31.760589 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-5d504280-d68c-4406-9cc1-28e1c49829f5 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410484 Sep 15 12:53:31.761122 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1292 bytes} [Thu Sep 15 12:53:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:53:31.786094 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-c77e8fba-2284-46ed-b34b-ef727c272d82 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:53:31.789723 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_api:SELECT=14 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:31.794584 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-c77e8fba-2284-46ed-b34b-ef727c272d82 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013594 Sep 15 12:53:31.795117 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1283 bytes} [Thu Sep 15 12:53:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:53:31.807704 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-209b8326-3cca-4f33-8fe7-2ff427c56ff5 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:53:31.815279 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-209b8326-3cca-4f33-8fe7-2ff427c56ff5 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011112 Sep 15 12:53:31.815788 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1286 bytes} [Thu Sep 15 12:53:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:53:31.827085 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-2fca5b04-c328-45af-b5b2-39cf8287a206 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:53:31.835123 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-2fca5b04-c328-45af-b5b2-39cf8287a206 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011783 Sep 15 12:53:31.835627 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1286 bytes} [Thu Sep 15 12:53:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:53:31.847802 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-d7936f6e-932c-414d-9e59-834689acb612 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:53:31.854860 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-d7936f6e-932c-414d-9e59-834689acb612 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011461 Sep 15 12:53:31.855376 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1283 bytes} [Thu Sep 15 12:53:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:56:29.296888 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-2fca5b04-c328-45af-b5b2-39cf8287a206 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:56:29.297915 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-2fca5b04-c328-45af-b5b2-39cf8287a206 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 15 12:56:29.298299 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Sep 15 12:56:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:56:29.440434 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_api:SELECT=6 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:56:29.598431 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-1ee7fbec-8831-46be-b034-20e0ac092a96 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:56:29.603151 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-1ee7fbec-8831-46be-b034-20e0ac092a96 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:56:29.603628 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-1ee7fbec-8831-46be-b034-20e0ac092a96 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:56:29.604062 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-1ee7fbec-8831-46be-b034-20e0ac092a96 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:56:29.604807 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-1ee7fbec-8831-46be-b034-20e0ac092a96 admin admin] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:56:29.605293 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-1ee7fbec-8831-46be-b034-20e0ac092a96 admin admin] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:56:29.605710 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-1ee7fbec-8831-46be-b034-20e0ac092a96 admin admin] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:56:29.638649 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-1ee7fbec-8831-46be-b034-20e0ac092a96 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.199320 Sep 15 12:56:29.639222 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Sep 15 12:56:29 2022] GET /compute/v2.1/os-services => generated 794 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:56:30.716692 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-2fca5b04-c328-45af-b5b2-39cf8287a206 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:56:30.717789 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-2fca5b04-c328-45af-b5b2-39cf8287a206 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Sep 15 12:56:30.718186 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Sep 15 12:56:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:56:30.910450 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-14cf9b73-52ef-4409-9909-694ed0afa73d admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:56:30.914988 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-14cf9b73-52ef-4409-9909-694ed0afa73d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:56:30.915537 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-14cf9b73-52ef-4409-9909-694ed0afa73d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:56:30.916318 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-14cf9b73-52ef-4409-9909-694ed0afa73d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:56:30.917093 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-14cf9b73-52ef-4409-9909-694ed0afa73d admin admin] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:56:30.918188 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-14cf9b73-52ef-4409-9909-694ed0afa73d admin admin] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:56:30.918616 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-14cf9b73-52ef-4409-9909-694ed0afa73d admin admin] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:56:30.940413 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-14cf9b73-52ef-4409-9909-694ed0afa73d admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.080756 Sep 15 12:56:30.941043 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Sep 15 12:56:30 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:56:42.473811 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-2fca5b04-c328-45af-b5b2-39cf8287a206 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:56:42.474802 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-2fca5b04-c328-45af-b5b2-39cf8287a206 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Sep 15 12:56:42.475186 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Sep 15 12:56:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:56:42.624367 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_cell0:SELECT=4 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:56:42.625071 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_cell1:SELECT=4 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:56:42.626118 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG dbcounter [-] [105423] Writing DB stats nova_api:SELECT=8 {{(pid=105423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:56:42.674851 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-e7b46f1f-25e5-451f-be2f-45669b3d925e admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:56:42.678221 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-e7b46f1f-25e5-451f-be2f-45669b3d925e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:56:42.678691 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-e7b46f1f-25e5-451f-be2f-45669b3d925e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:56:42.679115 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-e7b46f1f-25e5-451f-be2f-45669b3d925e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:56:42.679815 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-e7b46f1f-25e5-451f-be2f-45669b3d925e admin admin] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:56:42.680256 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-e7b46f1f-25e5-451f-be2f-45669b3d925e admin admin] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:56:42.680737 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-e7b46f1f-25e5-451f-be2f-45669b3d925e admin admin] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:56:42.706558 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-e7b46f1f-25e5-451f-be2f-45669b3d925e admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.087285 Sep 15 12:56:42.707099 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Sep 15 12:56:42 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:56:43.792237 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG nova.api.openstack.wsgi [None req-2fca5b04-c328-45af-b5b2-39cf8287a206 admin admin] Calling method '>' {{(pid=105422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:56:43.793324 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: INFO nova.api.openstack.requestlog [None req-2fca5b04-c328-45af-b5b2-39cf8287a206 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Sep 15 12:56:43.793710 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: [pid: 105422|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Sep 15 12:56:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:56:43.986501 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG nova.api.openstack.wsgi [None req-a31d6840-1998-4f90-9d4f-943856cd9db8 admin admin] Calling method '>' {{(pid=105423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:56:43.989900 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-a31d6840-1998-4f90-9d4f-943856cd9db8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:56:43.990374 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-a31d6840-1998-4f90-9d4f-943856cd9db8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:56:43.990800 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-a31d6840-1998-4f90-9d4f-943856cd9db8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:56:43.991503 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-a31d6840-1998-4f90-9d4f-943856cd9db8 admin admin] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:56:43.991949 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-a31d6840-1998-4f90-9d4f-943856cd9db8 admin admin] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:56:43.992392 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: DEBUG oslo_concurrency.lockutils [None req-a31d6840-1998-4f90-9d4f-943856cd9db8 admin admin] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:56:44.014694 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: INFO nova.api.openstack.requestlog [None req-a31d6840-1998-4f90-9d4f-943856cd9db8 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.080954 Sep 15 12:56:44.015175 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: [pid: 105423|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Sep 15 12:56:43 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:57:40.759769 dv-cinder-836083-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 15 12:57:40.760348 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: Thu Sep 15 12:57:40 2022 - graceful shutdown triggered... Sep 15 12:57:40.760790 dv-cinder-836083-13-iscsi devstack@n-api.service[105423]: Gracefully killing worker 2 (pid: 105423)... Sep 15 12:57:40.761140 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: Gracefully killing worker 1 (pid: 105422)... Sep 15 12:57:40.886284 dv-cinder-836083-13-iscsi devstack@n-api.service[105422]: DEBUG dbcounter [-] [105422] Writing DB stats nova_api:SELECT=4 {{(pid=105422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:57:41.761305 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: worker 1 buried after 1 seconds Sep 15 12:57:41.761305 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: worker 2 buried after 1 seconds Sep 15 12:57:41.761305 dv-cinder-836083-13-iscsi devstack@n-api.service[105421]: goodbye to uWSGI. Sep 15 12:57:41.763181 dv-cinder-836083-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 15 12:57:41.763758 dv-cinder-836083-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 15 12:57:41.767279 dv-cinder-836083-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 12:57:41.776610 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 12:57:41.779245 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 12:57:41 2022] *** Sep 15 12:57:41.779245 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 12:57:41.779245 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 12:57:41.779245 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: nodename: dv-cinder-836083-13-iscsi Sep 15 12:57:41.779245 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: machine: x86_64 Sep 15 12:57:41.779245 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: clock source: unix Sep 15 12:57:41.779245 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: pcre jit disabled Sep 15 12:57:41.779245 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: detected number of CPU cores: 4 Sep 15 12:57:41.779245 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: current working directory: / Sep 15 12:57:41.779245 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: detected binary path: /usr/bin/uwsgi-core Sep 15 12:57:41.779245 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: your processes number limit is 47680 Sep 15 12:57:41.779968 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: your memory page size is 4096 bytes Sep 15 12:57:41.779968 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: detected max file descriptor number: 2048 Sep 15 12:57:41.779968 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: lock engine: pthread robust mutexes Sep 15 12:57:41.779968 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: thunder lock: enabled Sep 15 12:57:41.779968 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 12:57:41.779968 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 12:57:41.820933 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: Python main interpreter initialized at 0x55c1de80c9c0 Sep 15 12:57:41.820933 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: python threads support enabled Sep 15 12:57:41.820933 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: your server socket listen backlog is limited to 100 connections Sep 15 12:57:41.820933 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: your mercy for graceful operations on workers is 90 seconds Sep 15 12:57:41.821409 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 12:57:41.821409 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: *** Operational MODE: preforking *** Sep 15 12:57:41.821641 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: *** uWSGI is running in multiple interpreter mode *** Sep 15 12:57:41.821641 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: spawned uWSGI master process (pid: 120621) Sep 15 12:57:41.821839 dv-cinder-836083-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 12:57:41.825114 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: spawned uWSGI worker 1 (pid: 120633, cores: 1) Sep 15 12:57:41.825114 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: spawned uWSGI worker 2 (pid: 120634, cores: 1) Sep 15 12:57:41.825114 dv-cinder-836083-13-iscsi devstack@n-api.service[120621]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 12:57:42.500701 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 12:57:42.508244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 12:57:43.674043 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:57:43.674043 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: from cryptography.utils import int_from_bytes Sep 15 12:57:43.674690 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:57:43.674690 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: from cryptography.utils import int_from_bytes Sep 15 12:57:43.676521 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:57:43.676521 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: from cryptography.utils import int_from_bytes Sep 15 12:57:43.676960 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:57:43.676960 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: from cryptography.utils import int_from_bytes Sep 15 12:57:46.130376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 12:57:46.130949 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 12:57:46.131168 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 12:57:46.131738 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 12:57:46.132157 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 12:57:46.132721 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.133226 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.133705 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.134192 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.134683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.135166 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.135654 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.136139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.136470 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 12:57:46.136911 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.137001 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 12:57:46.137075 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.137267 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.137584 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 12:57:46.137776 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-13-iscsi {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.137958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 12:57:46.138072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.138230 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 12:57:46.138394 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.138604 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.138721 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.138935 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.139046 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.139259 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.139364 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.139580 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.139692 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.139910 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.140008 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.140226 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.140447 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.140571 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.141148 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.141485 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.141748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.142062 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.142435 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.142670 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-13-iscsi {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.142909 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.143114 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.143348 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.143555 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.143804 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.144052 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.144265 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.144555 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.144774 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.144997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.145218 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.145438 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.145667 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.145889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.146124 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.146377 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.146623 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.146832 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.147067 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-13-iscsi {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.147273 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.147477 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.147659 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.147852 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.148003 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.148160 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.148330 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.148330 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.148697 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.148855 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.149008 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.149163 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.149319 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.149476 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.149630 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.149782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.149964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.149964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.150274 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-13-iscsi {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.150428 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.153209 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.153395 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.153553 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.153714 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.153887 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.154036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.154189 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.155344 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.155515 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.155683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.155831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.155988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.156189 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.156398 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.156565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.156744 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.156906 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.157065 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.157211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.157553 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.157709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.157866 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.157866 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.158152 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.158304 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.158459 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.158623 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.158780 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.158926 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.159095 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.159242 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.159396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.159551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.159705 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.159858 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.160005 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.160156 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.160341 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.160501 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.160657 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.160812 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.160978 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.161134 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.161297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.161456 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.161606 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.161760 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.161905 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.162060 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.162218 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.162372 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.162517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.162677 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.162844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.163000 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.163146 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.163305 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.163458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.163610 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.163756 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.163973 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.164128 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.164289 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.164476 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.164991 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.166100 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.166305 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.166458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.166614 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.166787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.166948 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.167094 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.167246 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.167399 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.167558 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.168220 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.168414 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.168564 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.168719 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.168876 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.169113 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.169270 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.169423 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.169576 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.169729 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.169886 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.170040 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.170188 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.170333 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.170499 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.170646 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.170800 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.170953 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.171108 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.171260 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.171543 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.171709 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.171882 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.172044 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.172199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.172380 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.172531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.172697 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.172858 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.173173 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.173339 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.173494 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.173640 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.173794 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.173949 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.174096 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.174252 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.174399 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.174555 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.175123 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.175473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.175834 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.175834 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.176126 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.176336 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.176506 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.176662 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.176808 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.176963 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.177116 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.177273 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.177433 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.177433 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.177773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.177943 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.178090 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.178240 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.178401 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.179736 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.180050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.180214 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.180383 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.180518 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.180648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.180773 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.180929 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.181031 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.181125 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.181220 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.181316 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.181449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.181553 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.181656 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.181748 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.181841 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.181926 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.182016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.182114 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.182207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.182292 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.182388 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.182474 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.182563 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.182656 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.182747 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.182839 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.182937 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.183022 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.183105 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.183188 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.183329 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.183423 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.183518 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.183604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.183695 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.183780 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.183863 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.183959 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.184045 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.184128 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.184218 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.184422 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.184518 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.184612 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.184704 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.184813 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.185167 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.185274 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.185388 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.185627 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.185747 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.186069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.186162 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.186255 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.186342 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.186504 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.186595 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.186686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.186772 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.186865 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.186958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.187051 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.187136 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.187225 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.187317 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.187401 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.187493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.187578 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.187670 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.187755 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.187845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.187936 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.188030 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.188116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.188206 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.188307 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.188406 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.188493 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.188590 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:57:46.188675 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.188766 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.188858 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.188943 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.189035 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.189035 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.189189 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.189279 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.189364 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.189447 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.189447 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.189619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.189704 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.189787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.189870 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.189953 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.190049 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.190144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.190237 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.190322 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.190405 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.190495 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.190585 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.190682 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.190777 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.190862 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.190945 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.191029 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.191122 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.191280 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.191378 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.191471 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.191562 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.191647 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.191743 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.191829 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.191919 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.192003 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.192086 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.192169 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.192353 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.192452 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.192538 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.192622 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.192713 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.192797 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.192890 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.192976 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.193059 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.193150 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.193242 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.193327 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.193424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.193520 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.193612 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.193697 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.193789 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.193887 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.193972 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.194069 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.194155 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.194238 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.194336 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.194439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.194525 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.194616 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.194708 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.194812 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.194949 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.195184 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.195279 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.195366 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.195446 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.195536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.195773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.195877 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.196184 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.196326 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.196431 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.196515 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.196661 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.196760 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.196846 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.196938 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.197023 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.197114 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.197213 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.197307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.197399 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.197399 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.197619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.197714 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.197850 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.197958 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.198045 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.198142 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.198229 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.198229 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.198391 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.198484 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.198568 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.198697 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.198791 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.199058 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.199199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.199380 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.199598 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.199727 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.199907 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.200014 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.200218 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.200408 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.200554 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.200658 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.200872 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.200982 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.201181 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.201273 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.201507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.201599 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.201841 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.201943 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.202149 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.202242 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.202461 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.202563 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.202781 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.202941 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.203094 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.203193 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.203405 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.203504 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.203723 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.203863 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.204038 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.204130 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.204391 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.204533 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.204713 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.204826 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.205029 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.205161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.205373 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.205503 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.205711 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.205822 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.206024 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.206128 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.206353 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.206464 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.206666 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.206775 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.206978 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.207089 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.207284 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.207395 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.207596 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.207707 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.207908 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.208011 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.208217 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.208350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.208554 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.208691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.208879 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.209007 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.209191 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.209305 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.209503 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.209610 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.209842 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.209942 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.210172 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.210294 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.210478 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.210581 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.210800 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.210895 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.211112 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.211216 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.211421 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.211515 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.211722 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.211825 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.212027 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.212120 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.212350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.213350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.213457 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.213533 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.213615 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.213696 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.213775 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.213871 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.213956 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.214036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.214116 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.214188 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.214258 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.215119 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.215254 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.215356 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.215471 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.215641 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.216024 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.216144 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.216447 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.216648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.216831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.216982 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.217127 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.217270 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.217426 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.217635 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.217779 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.217870 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.217962 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.218103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.218260 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.218363 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.218693 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.218803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.218930 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.219033 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.219257 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.219360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.219575 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.219669 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.219914 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.220175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.220293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.220394 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.220545 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.220664 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.220862 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.220966 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.221178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.221281 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.221502 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.221606 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.221820 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.221922 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.222135 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.222236 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.222449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.222561 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.222762 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.222878 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.223077 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.223178 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.223388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.223499 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.223694 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.223805 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.224012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.224113 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.224361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.224467 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.224677 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.224790 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.225001 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.225101 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.225308 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.225407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.225621 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.225727 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.225939 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.226043 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.226251 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.226346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.226568 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.226743 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.226888 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.227041 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.227183 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.227334 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.227484 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.227632 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.227786 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.227926 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.228121 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.228260 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.228435 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.228534 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.228736 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.228876 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.229031 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.229132 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.229347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.229448 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.229651 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.229757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.229965 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.230079 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.230435 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.230540 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.230776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.230884 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.231089 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.231197 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.231400 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.231500 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.231710 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.231803 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.232025 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.232125 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.232365 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.232497 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.232684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.232797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.232995 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.233120 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.233304 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.233411 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.233618 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.233719 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.233928 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.234040 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.234239 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.234340 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.234552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.234655 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.234860 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.235009 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.235152 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.235294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.235462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.235614 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.235764 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.235904 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.236045 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.236189 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.236383 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.236538 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.236731 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.236933 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.237081 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.237231 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.237379 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.237527 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.237682 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.237823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.237964 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.238105 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.238273 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.238428 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.238570 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.238719 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.238883 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.239095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.239253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.239405 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.239555 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.239702 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.239853 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.239994 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.240134 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.240359 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.240583 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.240740 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.240907 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.241047 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.241197 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.241348 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.241509 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.241663 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.241805 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.241946 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.242131 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.242282 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.242424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.242572 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.242714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.242865 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.243015 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.243164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.243305 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.243447 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.243595 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.243746 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.243899 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.244047 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.244188 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.244354 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.244493 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.244653 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.244803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.244950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.245091 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.245245 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.245416 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.245521 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.246315 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.246576 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.246669 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.246783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.246977 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.247130 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.247225 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.247446 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.247757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.247865 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.248076 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.248178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.248412 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.248522 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.248726 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.248831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.249038 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.249147 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.249356 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.249473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.249661 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.249757 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.249969 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.250070 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.250281 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.250424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.250608 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.250746 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.250915 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.251068 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.251224 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.251327 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.251526 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.251625 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.251834 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.251936 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.252139 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.252232 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.252470 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.252577 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.252778 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.252882 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.253090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.253229 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.253396 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.253585 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.253689 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.253789 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.253992 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.254087 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.254297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.254398 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.254613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.254709 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.254917 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.255085 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.255230 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.255336 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.255535 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.255637 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.255857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.255952 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.256166 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.256259 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.256646 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.256746 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.256840 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.256939 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.257119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.257219 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.257448 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.257543 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.257755 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.257854 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.258070 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.258178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.258385 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.258516 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.258698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.258792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.259012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.259115 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.259320 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.259468 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.259632 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.259727 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.259941 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.260044 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.260245 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.260364 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.260575 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.260688 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.260892 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.261051 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.261232 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.261450 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.261601 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.261869 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.261982 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.262071 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.262216 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.262320 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.262528 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.262629 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.262840 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.262941 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.263145 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.263246 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.263456 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.263551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.263763 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.263857 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.264072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.264172 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.264411 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.264511 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.264721 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.264815 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.265025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.265117 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.265335 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.265436 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.265646 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.265748 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.266208 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.266309 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.266514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.266617 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.266818 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.266918 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.267161 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.267278 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.267473 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.267586 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.267739 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.267972 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.268072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.268313 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.268411 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.268621 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.268717 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.268934 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.269028 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.269241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.269344 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.269567 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.269671 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.269872 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.269964 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.270177 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.270284 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.270480 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.270572 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.270789 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.270892 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.271094 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.271216 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.271398 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.271493 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.271703 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.271804 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.272023 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.272126 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.272361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.272458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.272668 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.272773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.272974 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.273073 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.273278 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.273370 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.273584 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.273689 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.273888 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.273983 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.274197 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.274291 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.274500 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.274594 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.274804 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.274905 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.275107 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.275209 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.275412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.275513 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.275716 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.275818 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.276037 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.276131 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.276370 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.276481 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.276679 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.276779 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.277529 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.277784 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.277884 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.277985 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.278184 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.278288 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.278499 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.278599 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.278861 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.278973 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.279170 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.279265 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.279487 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.279581 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.279810 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.279921 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.280123 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.280217 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.280459 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.280555 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.280933 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.281043 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.281134 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.281221 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.281383 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.281477 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.281693 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.281787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.282005 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.282097 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.282311 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.282412 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.282617 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.282712 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.282930 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.283031 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.283241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.283349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.283553 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.283647 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.283867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.283969 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.284178 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.284341 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.284516 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.284605 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.284815 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.284909 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.285122 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.285228 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.285430 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.285530 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.285741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.285835 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.286056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.286201 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.286374 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.286491 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.286682 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.286776 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.286996 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.287098 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.287307 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.287408 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.287620 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.287735 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.287931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.288045 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.288241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.288392 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.288589 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.288691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.288904 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.289027 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.289209 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.289311 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.289537 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.289634 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.289853 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.289967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.290160 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.290254 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.290474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.290630 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.290790 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.290981 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.291141 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.291291 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.291390 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.291575 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.291811 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.291917 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.292125 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.292218 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.292462 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.292611 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.292820 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.293121 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.293216 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.293443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.293606 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.293757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.293928 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.294066 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.294246 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.294395 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.294556 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.294708 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.294979 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.295092 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.295292 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.295445 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.295605 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.295763 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.295918 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.296073 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.296224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.296522 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.296636 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.296842 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.296944 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.297160 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.297260 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.297465 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.297571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.297771 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.297878 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.298073 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.298167 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.298394 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.298507 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.298705 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.298798 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.299025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.299133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.299354 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.299449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.299682 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.299784 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.299998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.300102 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.300340 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.300463 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.300652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.300764 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.300993 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.301161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.301311 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.301414 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.301630 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.301724 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.301956 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.302065 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.302304 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.302396 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.302620 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.302720 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.302926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.303053 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.303251 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.303346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.303576 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.303669 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.303891 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.303988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.304210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.304318 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.304542 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.304638 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.304866 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.304958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.305175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.305283 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.305494 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.305600 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.305801 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.305894 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.306116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.306210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.306431 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.306599 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.306745 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.306846 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.307054 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.307155 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.307365 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.307473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.307697 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.307816 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.308008 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.308105 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.308903 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.309039 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.309307 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.309405 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.309643 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.309737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.309970 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.310107 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.310281 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.310374 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.310594 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.310688 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.310907 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.311017 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.311218 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.311329 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.311521 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.311614 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.311828 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.311960 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.312154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.312247 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.312489 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.312597 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.312817 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.312919 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.313135 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.313228 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.313459 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.313567 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.313780 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.313910 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.314086 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.314178 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.314412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.314517 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.314726 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.314829 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.315034 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.315135 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.315340 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.315448 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.315647 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.315741 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.315971 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.316063 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.316295 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.316411 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.316619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.316712 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.316926 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.317026 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.317233 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.317328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.317541 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.317634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.317856 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.317958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.318162 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.318265 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.318465 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.318558 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.318770 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.318871 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.319095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.319190 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.319405 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.319515 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.319723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.319824 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.320027 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.320128 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.320365 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.320480 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.320672 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.320776 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.320978 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.321078 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.321296 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.321402 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.321587 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.321740 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.321890 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.321993 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.322194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.322291 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.322497 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.322602 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.322819 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.322914 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.323127 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.323223 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.323449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.323544 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.323762 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.323904 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.324247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.324397 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.324551 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.324655 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.324859 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.324953 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.325203 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.325305 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.325512 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.325607 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.325839 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.325933 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.326150 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.326249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.326474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.326672 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.326793 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.327004 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.327098 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.327324 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.327421 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.327643 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.327745 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.327962 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.328056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.328290 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.328396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.328618 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.328720 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.328934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.329029 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.329251 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.329394 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.329567 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.329663 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.329884 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.329985 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.330215 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.330404 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.330541 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.330735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.330871 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.331052 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.331209 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.331402 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.331521 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.331679 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.331841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.331995 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.332159 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.332339 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.332501 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.332634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.332860 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.332967 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.333179 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.333272 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.333488 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.333590 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.333804 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.333906 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.334120 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.334215 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.334437 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.334532 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.334752 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.334856 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.335065 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.335161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.335380 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.335484 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.335695 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.335797 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.336008 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.336102 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.336341 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.336516 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.336660 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.336764 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.336975 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.337076 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.337291 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.337385 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.337606 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.337700 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.337920 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.338015 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.338237 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.338343 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.338547 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.338642 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.338861 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.338956 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.339178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.339378 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.340156 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.340250 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.340400 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.340597 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.340702 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.340926 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.341022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.341258 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.341360 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.341582 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.341689 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.341899 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.341994 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.342223 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.342312 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.342537 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.342677 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.342843 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.342941 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.343159 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.343359 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.343470 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.343678 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.343781 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.344014 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.344128 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.344362 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.344481 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.344688 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.344784 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.345009 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.345102 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.345319 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.345414 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.345645 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.345855 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.345950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.346209 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.346312 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.346529 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.346631 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.346846 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.346945 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.347153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.347260 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.347478 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.347580 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.347787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.347879 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.348091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.348191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.348485 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.348593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.348746 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.348841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.349070 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.349285 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.349439 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.349636 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.349781 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.349952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.350112 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.350262 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.350405 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.350582 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.350734 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.350878 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.351030 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.351179 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.351320 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.351468 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.351634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.351860 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.352007 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.352157 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.352410 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.352565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.352666 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.352763 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.352851 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.352999 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.353101 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.353303 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.353435 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.353613 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.353735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.353922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.354016 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.354240 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.354386 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.354558 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.354662 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.354829 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.354924 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.355235 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.355397 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.355542 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.355640 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.355836 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.355931 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.356146 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.356249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.356485 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.356612 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.356793 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.356922 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.357100 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.357249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.357407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.357559 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.357714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.357866 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.358026 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.358184 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.358332 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.358522 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.358723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.358820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.359034 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.359143 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.359347 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.359448 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.359695 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.359790 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.360006 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.360101 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.360331 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.360612 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.360720 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.360948 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.361051 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.361253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.361354 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.361567 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.361660 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.361882 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.362027 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.362202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.362311 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.362535 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.362637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.362819 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.362913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.363150 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.363255 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.363465 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.363569 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.363783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.363995 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.364099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.364356 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.364521 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.364681 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.364787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.365014 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.365118 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.365333 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.365426 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.365640 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.365746 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.365947 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.366041 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.366251 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.366352 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.366562 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.366658 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.366873 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.366968 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.367185 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.367280 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.367493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.367595 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.367805 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.367899 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.368116 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.368216 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.368448 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.368545 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.368763 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.368871 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.369078 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.369184 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.369389 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.369485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.369698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.369840 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.370010 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.370118 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.370318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.370419 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.370626 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.371293 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.371483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.371594 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.371816 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.372021 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.372122 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.372208 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.372457 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.372559 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.372795 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.372953 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.373117 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.373221 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.373436 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.373532 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.373750 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.373845 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.374063 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.374164 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.374374 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.374468 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.374687 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.374784 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.375005 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.375113 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.375328 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.375437 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.375647 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.375784 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.375954 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.376078 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.376329 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.376450 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.376664 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.376769 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.376992 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.377099 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.377302 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.377398 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.377611 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.377712 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.377917 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.378018 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.378229 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.378349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.378542 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.378644 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.378858 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.378961 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.379162 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.379264 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.379468 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.379569 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.379798 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.379892 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.380090 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.380193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.380417 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.380513 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.380743 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.380846 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.381031 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.381134 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.381341 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.381449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.381649 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.381750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.381957 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.382121 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.382262 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.382369 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.382567 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.382672 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.382870 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.383015 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.383176 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.383286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.383479 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.383581 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.383884 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.384084 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.384191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.384410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.384508 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.384721 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.384822 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.385025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.385120 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.385327 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.385427 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.385632 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.385733 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.385934 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.386033 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.386238 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.386431 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.386574 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.386698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.386888 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.387024 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.387193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.387339 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.387499 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.387664 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.387805 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.387988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.388110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.388328 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.388452 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.388647 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.388770 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.388984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.389089 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.389298 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.389411 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.389613 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.389727 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.389931 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.390041 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.390243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.390347 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.390556 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.390659 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.391112 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.391209 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.391452 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.391565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.391765 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.391859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.392083 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.392207 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.392441 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.392552 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.392754 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.392850 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.393068 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.393162 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.393386 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.393748 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.393748 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.393986 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.393986 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.394153 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.394291 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.394402 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.394613 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.394708 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.394924 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.395067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.395229 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.395330 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.395539 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.395632 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.395856 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.395994 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.396166 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.396263 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.396483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.396801 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.396922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.397120 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.397233 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.397447 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.397551 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.397761 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.397855 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.398071 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.398165 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.398379 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.398472 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.398692 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.398786 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.399004 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.399096 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.399325 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.399428 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.399635 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.399731 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.399946 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.400041 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.400264 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.400393 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.400596 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.400705 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.400923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.401023 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.401167 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 12:57:46.401258 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.401541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.401864 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.402714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.403341 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.403463 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.403703 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.404031 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.404367 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.404685 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.404995 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:57:46.405236 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 12:57:46.463200 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO dbcounter [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] Registered counter for database nova_api Sep 15 12:57:46.466873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO dbcounter [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] Registered counter for database nova_api Sep 15 12:57:46.484864 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_db.sqlalchemy.engines [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:57:46.487134 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_db.sqlalchemy.engines [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:57:46.491680 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writer thread running {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:57:46.493678 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writer thread running {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:57:46.548846 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.context [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6795f125-b3e5-4c74-8d4a-d8548f3dc3a0(cell1) {{(pid=120634) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 12:57:46.549206 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.context [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6795f125-b3e5-4c74-8d4a-d8548f3dc3a0(cell1) {{(pid=120633) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 12:57:46.552922 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:57:46.553193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:57:46.553402 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:57:46.553660 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:57:46.554975 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:57:46.555203 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:57:46.555746 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:57:46.555934 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:57:46.556195 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:57:46.556402 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:57:46.558253 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:57:46.558439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:57:46.560252 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO dbcounter [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] Registered counter for database nova_cell0 Sep 15 12:57:46.560426 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO dbcounter [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] Registered counter for database nova_cell0 Sep 15 12:57:46.564368 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO dbcounter [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] Registered counter for database nova_cell1 Sep 15 12:57:46.564505 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO dbcounter [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] Registered counter for database nova_cell1 Sep 15 12:57:46.571340 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_db.sqlalchemy.engines [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:57:46.573033 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_db.sqlalchemy.engines [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:57:46.575349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_db.sqlalchemy.engines [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:57:46.576796 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_db.sqlalchemy.engines [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:57:46.580850 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writer thread running {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:57:46.581573 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writer thread running {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:57:46.585985 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writer thread running {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:57:46.725000 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writer thread running {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:57:46.735422 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO dbcounter [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] Registered counter for database nova_cell0 Sep 15 12:57:46.736808 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO dbcounter [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] Registered counter for database nova_cell0 Sep 15 12:57:46.742209 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_db.sqlalchemy.engines [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:57:46.745041 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_db.sqlalchemy.engines [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:57:46.749505 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writer thread running {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:57:46.750857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writer thread running {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:57:47.071108 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: WARNING keystonemiddleware.auth_token [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:57:47.075623 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: WARNING keystonemiddleware.auth_token [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:57:47.078923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: WARNING keystonemiddleware.auth_token [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:57:47.082892 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: WARNING keystonemiddleware.auth_token [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:57:47.426539 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: WARNING keystonemiddleware.auth_token [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:57:47.432075 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: WARNING keystonemiddleware.auth_token [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:57:47.433105 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: WARNING keystonemiddleware.auth_token [None req-db97eff5-f1a5-4fd1-8062-2807f76665e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:57:47.438550 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1de80c9c0 pid: 120633 (default app) Sep 15 12:57:47.439025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: WARNING keystonemiddleware.auth_token [None req-8cac48db-0c88-4a5d-b10e-3a31111f67fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:57:47.444379 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1de80c9c0 pid: 120634 (default app) Sep 15 12:58:24.521530 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=3 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:24.522599 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=3 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:24.524878 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=3 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:24.525945 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=3 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:24.869932 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=3 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:24.873464 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=3 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:24.877862 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=3 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:24.882347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=3 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:26.008024 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9ba7ec37-cdd6-429d-96fc-6923826d9935 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Action: 'create', calling method: .version_select at 0x7f62c6502430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-369552394", "metadata": {"Type": "work"}}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9ba7ec37-cdd6-429d-96fc-6923826d9935 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Request method failure captured: Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 121 Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyFwqThiuKk91_PyipYzXxubwnpjW3N3KRgnNZMNpa9IfuKN2TWVSOrj4uzqCox8ZlXcMPIUN-UH6ZPV4Ebntap0xslTg4bF6z00wRumYK_OUQCrUrcdiDObY_m2WernoFXnh0iAEseTl6XnCdt3EZjebL7SmTmwpHtqhhYa-XLYONs Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 1741b69bb2be4ef08c76a4e0fb6e1487 Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 12:58:26.016410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 12:58:26.017889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1741b69bb2be4ef08c76a4e0fb6e1487", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1741b69bb2be4ef08c76a4e0fb6e1487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1741b69bb2be4ef08c76a4e0fb6e1487"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1741b69bb2be4ef08c76a4e0fb6e1487"}]}] Sep 15 12:58:26.017889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:26.017889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 1741b69bb2be4ef08c76a4e0fb6e1487 Sep 15 12:58:26.017889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:26.017889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-VolumesNegativeTest-1394329093-project Sep 15 12:58:26.017889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 12:58:26.017889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 12:58:26.017889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 204936c53844491682cef72ce215e035 Sep 15 12:58:26.017889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-VolumesNegativeTest-1394329093-project Sep 15 12:58:26.017889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Sep 15 12:58:26.017889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-369552394", "metadata": {"Type": "work"}}} Sep 15 12:58:26.017889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: Sep 15 12:58:26.017889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-369552394', 'metadata': {'Type': 'work'}}}} Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise error Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi '#$%' Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:58:26.018673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 12:58:26.020016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 12:58:26.023978 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 12:58:26.023978 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.023978 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9ba7ec37-cdd6-429d-96fc-6923826d9935 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:58:26.023978 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9ba7ec37-cdd6-429d-96fc-6923826d9935 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.508828 Sep 15 12:58:26.024584 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1998674b-6d90-43f8-8305-0cd9a427b2ba tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] Action: 'create', calling method: .version_select at 0x7f62c6503430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-663896912", "metadata": {"Type": "work"}}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:58:26.025168 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1156 bytes} [Thu Sep 15 12:58:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1516 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 12:58:26.031281 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2c9c7f8f-53a2-47d5-bbcf-4c3efdc221f7 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Action: 'create', calling method: .version_select at 0x7f62c6502d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-447287359", "metadata": {"Type": "work"}}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2c9c7f8f-53a2-47d5-bbcf-4c3efdc221f7 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Request method failure captured: Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 119 Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyFwqThiuKk91_PyipYzXxubwnpjW3N3KRgnNZMNpa9IfuKN2TWVSOrj4uzqCox8ZlXcMPIUN-UH6ZPV4Ebntap0xslTg4bF6z00wRumYK_OUQCrUrcdiDObY_m2WernoFXnh0iAEseTl6XnCdt3EZjebL7SmTmwpHtqhhYa-XLYONs Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 1741b69bb2be4ef08c76a4e0fb6e1487 Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 12:58:26.035923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 12:58:26.037536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1741b69bb2be4ef08c76a4e0fb6e1487", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1741b69bb2be4ef08c76a4e0fb6e1487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1741b69bb2be4ef08c76a4e0fb6e1487"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1741b69bb2be4ef08c76a4e0fb6e1487"}]}] Sep 15 12:58:26.037536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:26.037536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 1741b69bb2be4ef08c76a4e0fb6e1487 Sep 15 12:58:26.037536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:26.037536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-VolumesNegativeTest-1394329093-project Sep 15 12:58:26.037536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 12:58:26.037536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 12:58:26.037536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 204936c53844491682cef72ce215e035 Sep 15 12:58:26.037536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-VolumesNegativeTest-1394329093-project Sep 15 12:58:26.037536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Sep 15 12:58:26.037536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-447287359", "metadata": {"Type": "work"}}} Sep 15 12:58:26.037536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: Sep 15 12:58:26.037536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-447287359', 'metadata': {'Type': 'work'}}}} Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise error Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi '0' Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:58:26.038307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 12:58:26.039565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 12:58:26.043908 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 12:58:26.043908 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.043908 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2c9c7f8f-53a2-47d5-bbcf-4c3efdc221f7 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:58:26.043908 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2c9c7f8f-53a2-47d5-bbcf-4c3efdc221f7 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011706 Sep 15 12:58:26.043908 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 2/2] 10.222.0.57 () {60 vars in 1156 bytes} [Thu Sep 15 12:58:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 12:58:26.060532 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-443b8248-3acf-4097-b8b0-e89574e99ba0 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Action: 'create', calling method: .version_select at 0x7f62c63bf160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1038792992", "metadata": {"Type": "work"}}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-443b8248-3acf-4097-b8b0-e89574e99ba0 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Request method failure captured: Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 119 Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyFwqThiuKk91_PyipYzXxubwnpjW3N3KRgnNZMNpa9IfuKN2TWVSOrj4uzqCox8ZlXcMPIUN-UH6ZPV4Ebntap0xslTg4bF6z00wRumYK_OUQCrUrcdiDObY_m2WernoFXnh0iAEseTl6XnCdt3EZjebL7SmTmwpHtqhhYa-XLYONs Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 1741b69bb2be4ef08c76a4e0fb6e1487 Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 12:58:26.064950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 12:58:26.066318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1741b69bb2be4ef08c76a4e0fb6e1487", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1741b69bb2be4ef08c76a4e0fb6e1487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1741b69bb2be4ef08c76a4e0fb6e1487"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1741b69bb2be4ef08c76a4e0fb6e1487"}]}] Sep 15 12:58:26.066318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:26.066318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 1741b69bb2be4ef08c76a4e0fb6e1487 Sep 15 12:58:26.066318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:26.066318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-VolumesNegativeTest-1394329093-project Sep 15 12:58:26.066318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 12:58:26.066318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 12:58:26.066318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 204936c53844491682cef72ce215e035 Sep 15 12:58:26.066318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-VolumesNegativeTest-1394329093-project Sep 15 12:58:26.066318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Sep 15 12:58:26.066318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1038792992", "metadata": {"Type": "work"}}} Sep 15 12:58:26.066318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: Sep 15 12:58:26.066318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1038792992', 'metadata': {'Type': 'work'}}}} Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise error Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi '' Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:58:26.067090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 12:58:26.069158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 12:58:26.074149 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 12:58:26.074149 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:26.074149 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-443b8248-3acf-4097-b8b0-e89574e99ba0 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:58:26.074149 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-443b8248-3acf-4097-b8b0-e89574e99ba0 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021784 Sep 15 12:58:26.074149 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 3/3] 10.222.0.57 () {60 vars in 1156 bytes} [Thu Sep 15 12:58:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 12:58:26.104790 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8bd3ec07-19ed-4fb5-a958-ffa3fbb26702 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Calling method '.version_select at 0x7f62c63bfb80>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:27.353156 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-8bd3ec07-19ed-4fb5-a958-ffa3fbb26702 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] HTTP exception thrown: Volume tempest-invalid-587723022 could not be found. Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8bd3ec07-19ed-4fb5-a958-ffa3fbb26702 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Request method failure captured: Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-587723022 HTTP/1.1 Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyFwqThiuKk91_PyipYzXxubwnpjW3N3KRgnNZMNpa9IfuKN2TWVSOrj4uzqCox8ZlXcMPIUN-UH6ZPV4Ebntap0xslTg4bF6z00wRumYK_OUQCrUrcdiDObY_m2WernoFXnh0iAEseTl6XnCdt3EZjebL7SmTmwpHtqhhYa-XLYONs Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 1741b69bb2be4ef08c76a4e0fb6e1487 Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 12:58:27.357224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 12:58:27.358748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1741b69bb2be4ef08c76a4e0fb6e1487", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1741b69bb2be4ef08c76a4e0fb6e1487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1741b69bb2be4ef08c76a4e0fb6e1487"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1741b69bb2be4ef08c76a4e0fb6e1487"}]}] Sep 15 12:58:27.358748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:27.358748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 1741b69bb2be4ef08c76a4e0fb6e1487 Sep 15 12:58:27.358748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:27.358748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-VolumesNegativeTest-1394329093-project Sep 15 12:58:27.358748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 12:58:27.358748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 12:58:27.358748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 204936c53844491682cef72ce215e035 Sep 15 12:58:27.358748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-VolumesNegativeTest-1394329093-project Sep 15 12:58:27.358748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: Sep 15 12:58:27.358748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Volume tempest-invalid-587723022 could not be found. Sep 15 12:58:27.358748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': 'tempest-invalid-587723022'} Sep 15 12:58:27.358748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-587723022 could not be found. (HTTP 404) (Request-ID: req-3e21e5a4-9c90-4f98-9291-86e9eaf3d75e) Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:27.359684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 12:58:27.361244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-587723022 could not be found. Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:58:27.362971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-587723022 could not be found. Sep 15 12:58:27.364397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.364397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:27.364397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.364397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:27.364397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:58:27.364397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:58:27.364397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:58:27.364397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:58:27.364397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-587723022 could not be found. Sep 15 12:58:27.364397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.364397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8bd3ec07-19ed-4fb5-a958-ffa3fbb26702 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Returning 404 to user: Volume tempest-invalid-587723022 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:58:27.365770 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8bd3ec07-19ed-4fb5-a958-ffa3fbb26702 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-587723022" status: 404 len: 98 microversion: 2.1 time: 1.290134 Sep 15 12:58:27.366435 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 4/4] 10.222.0.57 () {58 vars in 1215 bytes} [Thu Sep 15 12:58:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-587723022 => generated 98 bytes in 1293 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 15 12:58:27.386373 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b58a2cd0-f3c7-4844-8d07-63bd96809c5d tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005334 Sep 15 12:58:27.400052 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 5/5] 10.222.0.57 () {58 vars in 1140 bytes} [Thu Sep 15 12:58:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 15 12:58:27.411473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-697c27d0-da54-4794-bfe0-b5de3b9c25ab tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004275 Sep 15 12:58:27.418823 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 6/6] 10.222.0.57 () {58 vars in 1137 bytes} [Thu Sep 15 12:58:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 15 12:58:27.424142 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f8a471a2-ad80-41db-98ff-40039423f971 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Calling method '.version_select at 0x7f62c62f33a0>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:27.478735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-f8a471a2-ad80-41db-98ff-40039423f971 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] HTTP exception thrown: Volume 627e9d67-6c02-4346-8374-4130a24cfb40 could not be found. Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f8a471a2-ad80-41db-98ff-40039423f971 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Request method failure captured: Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: DELETE /compute/v2.1/os-volumes/627e9d67-6c02-4346-8374-4130a24cfb40 HTTP/1.1 Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyFwqThiuKk91_PyipYzXxubwnpjW3N3KRgnNZMNpa9IfuKN2TWVSOrj4uzqCox8ZlXcMPIUN-UH6ZPV4Ebntap0xslTg4bF6z00wRumYK_OUQCrUrcdiDObY_m2WernoFXnh0iAEseTl6XnCdt3EZjebL7SmTmwpHtqhhYa-XLYONs Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 1741b69bb2be4ef08c76a4e0fb6e1487 Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 12:58:27.481749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 12:58:27.483375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1741b69bb2be4ef08c76a4e0fb6e1487", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1741b69bb2be4ef08c76a4e0fb6e1487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1741b69bb2be4ef08c76a4e0fb6e1487"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1741b69bb2be4ef08c76a4e0fb6e1487"}]}] Sep 15 12:58:27.483375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:27.483375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 1741b69bb2be4ef08c76a4e0fb6e1487 Sep 15 12:58:27.483375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:27.483375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-VolumesNegativeTest-1394329093-project Sep 15 12:58:27.483375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 12:58:27.483375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 12:58:27.483375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 204936c53844491682cef72ce215e035 Sep 15 12:58:27.483375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-VolumesNegativeTest-1394329093-project Sep 15 12:58:27.483375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: Sep 15 12:58:27.483375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Volume 627e9d67-6c02-4346-8374-4130a24cfb40 could not be found. Sep 15 12:58:27.483375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '627e9d67-6c02-4346-8374-4130a24cfb40'} Sep 15 12:58:27.483375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 627e9d67-6c02-4346-8374-4130a24cfb40 could not be found. (HTTP 404) (Request-ID: req-453c53f3-e1e0-4d0d-b709-ddc9cc28bcd5) Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:27.484557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 12:58:27.485942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 627e9d67-6c02-4346-8374-4130a24cfb40 could not be found. Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 12:58:27.487241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:58:27.488541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 627e9d67-6c02-4346-8374-4130a24cfb40 could not be found. Sep 15 12:58:27.488541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.488541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:27.488541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.488541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:27.488541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:58:27.488541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:58:27.488541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:58:27.488541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:58:27.488541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 627e9d67-6c02-4346-8374-4130a24cfb40 could not be found. Sep 15 12:58:27.488541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.488541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f8a471a2-ad80-41db-98ff-40039423f971 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Returning 404 to user: Volume 627e9d67-6c02-4346-8374-4130a24cfb40 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:58:27.490103 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f8a471a2-ad80-41db-98ff-40039423f971 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/627e9d67-6c02-4346-8374-4130a24cfb40" status: 404 len: 109 microversion: 2.1 time: 0.070051 Sep 15 12:58:27.491341 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 7/7] 10.222.0.57 () {58 vars in 1248 bytes} [Thu Sep 15 12:58:27 2022] DELETE /compute/v2.1/os-volumes/627e9d67-6c02-4346-8374-4130a24cfb40 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 12:58:27.503744 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-42826872-ed8f-4e10-8cb9-4af2f2400994 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Calling method '.version_select at 0x7f62c62f3280>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:27.616786 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-42826872-ed8f-4e10-8cb9-4af2f2400994 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] HTTP exception thrown: Volume 88aa7ad6-7193-49ed-ae77-7d0c93a76fe0 could not be found. Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-42826872-ed8f-4e10-8cb9-4af2f2400994 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Request method failure captured: Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/os-volumes/88aa7ad6-7193-49ed-ae77-7d0c93a76fe0 HTTP/1.1 Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyFwqThiuKk91_PyipYzXxubwnpjW3N3KRgnNZMNpa9IfuKN2TWVSOrj4uzqCox8ZlXcMPIUN-UH6ZPV4Ebntap0xslTg4bF6z00wRumYK_OUQCrUrcdiDObY_m2WernoFXnh0iAEseTl6XnCdt3EZjebL7SmTmwpHtqhhYa-XLYONs Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 1741b69bb2be4ef08c76a4e0fb6e1487 Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 12:58:27.618929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 12:58:27.621022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1741b69bb2be4ef08c76a4e0fb6e1487", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1741b69bb2be4ef08c76a4e0fb6e1487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1741b69bb2be4ef08c76a4e0fb6e1487"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1741b69bb2be4ef08c76a4e0fb6e1487"}]}] Sep 15 12:58:27.621022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:27.621022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 1741b69bb2be4ef08c76a4e0fb6e1487 Sep 15 12:58:27.621022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-VolumesNegativeTest-1394329093 Sep 15 12:58:27.621022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-VolumesNegativeTest-1394329093-project Sep 15 12:58:27.621022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 12:58:27.621022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 12:58:27.621022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 204936c53844491682cef72ce215e035 Sep 15 12:58:27.621022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-VolumesNegativeTest-1394329093-project Sep 15 12:58:27.621022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: Sep 15 12:58:27.621022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Volume 88aa7ad6-7193-49ed-ae77-7d0c93a76fe0 could not be found. Sep 15 12:58:27.621022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '88aa7ad6-7193-49ed-ae77-7d0c93a76fe0'} Sep 15 12:58:27.621022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88aa7ad6-7193-49ed-ae77-7d0c93a76fe0 could not be found. (HTTP 404) (Request-ID: req-c4daad64-3e10-4bbb-bcac-cb4055c8a43e) Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:27.621897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 12:58:27.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88aa7ad6-7193-49ed-ae77-7d0c93a76fe0 could not be found. Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 12:58:27.624629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:58:27.625916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88aa7ad6-7193-49ed-ae77-7d0c93a76fe0 could not be found. Sep 15 12:58:27.625916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.625916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:27.625916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.625916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:27.625916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:58:27.625916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:58:27.625916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:58:27.625916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:58:27.625916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88aa7ad6-7193-49ed-ae77-7d0c93a76fe0 could not be found. Sep 15 12:58:27.625916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:27.626934 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-42826872-ed8f-4e10-8cb9-4af2f2400994 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] Returning 404 to user: Volume 88aa7ad6-7193-49ed-ae77-7d0c93a76fe0 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:58:27.628028 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-42826872-ed8f-4e10-8cb9-4af2f2400994 tempest-VolumesNegativeTest-1394329093 tempest-VolumesNegativeTest-1394329093-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/88aa7ad6-7193-49ed-ae77-7d0c93a76fe0" status: 404 len: 109 microversion: 2.1 time: 0.129731 Sep 15 12:58:27.629848 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 8/8] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 12:58:27 2022] GET /compute/v2.1/os-volumes/88aa7ad6-7193-49ed-ae77-7d0c93a76fe0 => generated 109 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:58:27.754879 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1998674b-6d90-43f8-8305-0cd9a427b2ba tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.892826 Sep 15 12:58:27.768591 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 1/9] 10.222.0.57 () {60 vars in 1156 bytes} [Thu Sep 15 12:58:24 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2909 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 15 12:58:27.777408 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-1079f9eb-4bf4-4dc8-9616-3b6d5722064b tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] Calling method '.version_select at 0x7f62c63bfdc0>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:27.910505 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-1079f9eb-4bf4-4dc8-9616-3b6d5722064b tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d" status: 200 len: 352 microversion: 2.1 time: 0.142667 Sep 15 12:58:27.911068 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 9/10] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 12:58:27 2022] GET /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d => generated 352 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:58:28.941848 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a70c792f-8da9-446e-b15b-cf77e19b7b62 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] Calling method '.version_select at 0x7f62c63d6310>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:29.135221 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a70c792f-8da9-446e-b15b-cf77e19b7b62 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d" status: 200 len: 352 microversion: 2.1 time: 0.212158 Sep 15 12:58:29.136751 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 2/11] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 12:58:28 2022] GET /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d => generated 352 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:58:30.151242 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0513ae24-9663-42f4-91b8-2d843da94ca9 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] Calling method '.version_select at 0x7f62c62f3940>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:30.264175 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0513ae24-9663-42f4-91b8-2d843da94ca9 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d" status: 200 len: 353 microversion: 2.1 time: 0.117137 Sep 15 12:58:30.283795 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 10/12] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 12:58:30 2022] GET /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:58:30.287319 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2008b2b4-73b3-403d-89c3-29ec1d5c50e7 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] Calling method '.version_select at 0x7f62c63d69d0>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:30.418780 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2008b2b4-73b3-403d-89c3-29ec1d5c50e7 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d" status: 200 len: 353 microversion: 2.1 time: 0.140710 Sep 15 12:58:30.419367 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 3/13] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 12:58:30 2022] GET /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:58:30.434021 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-6ee12c77-954e-42c8-92ff-8a54dacaece9 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] Calling method '.version_select at 0x7f62c62f31f0>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:30.622795 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-6ee12c77-954e-42c8-92ff-8a54dacaece9 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d" status: 202 len: 0 microversion: 2.1 time: 0.193480 Sep 15 12:58:30.626863 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 11/14] 10.222.0.57 () {58 vars in 1248 bytes} [Thu Sep 15 12:58:30 2022] DELETE /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:58:30.632125 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0054fcd0-8023-4bcd-9ba7-dc851d8978a6 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] Calling method '.version_select at 0x7f62c636e0d0>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:30.720828 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0054fcd0-8023-4bcd-9ba7-dc851d8978a6 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d" status: 200 len: 352 microversion: 2.1 time: 0.092294 Sep 15 12:58:30.721683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 4/15] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 12:58:30 2022] GET /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:58:31.737651 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-70090afe-bb25-4cf8-a2dc-b3c641b14d43 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] Calling method '.version_select at 0x7f62c62f38b0>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:31.797821 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-70090afe-bb25-4cf8-a2dc-b3c641b14d43 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] HTTP exception thrown: Volume a9ff1d80-9e52-4d24-957a-be4556a2157d could not be found. Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-70090afe-bb25-4cf8-a2dc-b3c641b14d43 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] Request method failure captured: Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d HTTP/1.1 Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyFwO2L9Z70IB12Z61qGt9ryPk1DP_ORHXi2d7d3Y1n-61WqsXFmE_yf-ORk65vrYJxFAutc-68Uzgw7KXlnhsB5AWwoRft3jtOjqXoyFSA1ciIRgNCF4wenknuDco1E3vCB3ouIQuToENQx3TVVpLGf6MNui7YBdFKvJJ9MevAiJP8 Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 29549a86d26043369f989b70d85596d2 Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-VolumesGetTestJSON-1697547942 Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 12:58:31.799782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 12:58:31.801407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_29549a86d26043369f989b70d85596d2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/29549a86d26043369f989b70d85596d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/29549a86d26043369f989b70d85596d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/29549a86d26043369f989b70d85596d2"}]}] Sep 15 12:58:31.801407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-VolumesGetTestJSON-1697547942 Sep 15 12:58:31.801407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 29549a86d26043369f989b70d85596d2 Sep 15 12:58:31.801407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-VolumesGetTestJSON-1697547942 Sep 15 12:58:31.801407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-VolumesGetTestJSON-1697547942-project Sep 15 12:58:31.801407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 12:58:31.801407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 12:58:31.801407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 21f78ba4b48249c688c3e3ed968d09d8 Sep 15 12:58:31.801407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-VolumesGetTestJSON-1697547942-project Sep 15 12:58:31.801407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: Sep 15 12:58:31.801407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Volume a9ff1d80-9e52-4d24-957a-be4556a2157d could not be found. Sep 15 12:58:31.801407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': 'a9ff1d80-9e52-4d24-957a-be4556a2157d'} Sep 15 12:58:31.801407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a9ff1d80-9e52-4d24-957a-be4556a2157d could not be found. (HTTP 404) (Request-ID: req-063051c8-4550-4162-86c5-215411ff644a) Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:31.805247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 12:58:31.806423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a9ff1d80-9e52-4d24-957a-be4556a2157d could not be found. Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 12:58:31.807951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:58:31.811612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a9ff1d80-9e52-4d24-957a-be4556a2157d could not be found. Sep 15 12:58:31.811612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:31.811612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:58:31.811612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:31.811612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:58:31.811612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:58:31.811612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:58:31.811612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:58:31.811612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:58:31.811612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a9ff1d80-9e52-4d24-957a-be4556a2157d could not be found. Sep 15 12:58:31.811612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:58:31.811612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-70090afe-bb25-4cf8-a2dc-b3c641b14d43 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] Returning 404 to user: Volume a9ff1d80-9e52-4d24-957a-be4556a2157d could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:58:31.811612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-70090afe-bb25-4cf8-a2dc-b3c641b14d43 tempest-VolumesGetTestJSON-1697547942 tempest-VolumesGetTestJSON-1697547942-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d" status: 404 len: 109 microversion: 2.1 time: 0.069604 Sep 15 12:58:31.811612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 12/16] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 12:58:31 2022] GET /compute/v2.1/os-volumes/a9ff1d80-9e52-4d24-957a-be4556a2157d => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:58:36.054936 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0350eb31-a9f8-4863-bb07-9132e4dccf52 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Action: 'create', calling method: .version_select at 0x7f62c63d6ee0>, body: {"keypair": {"name": "tempest-keypair-1975026908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7V4fjEwIGNMM7knVNFMIW8KfW53XZGhfSe6E4e+Wzi8Ya+9M663HJ5n9LiOqcqNPdq9hxzpWE2I4BIg9dDJehl1bHxNyvi+n9yBB9QrNwjiaPsTNpMBqddXQBZkN+w2w=="}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:58:36.189675 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-0350eb31-a9f8-4863-bb07-9132e4dccf52 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'key_pairs'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:58:36.209570 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-0350eb31-a9f8-4863-bb07-9132e4dccf52 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for user cd22d2df9ced4bb0961596385854422d and project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'key_pairs'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:58:36.310819 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0350eb31-a9f8-4863-bb07-9132e4dccf52 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.784855 Sep 15 12:58:36.318563 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 5/17] 10.222.0.57 () {60 vars in 1159 bytes} [Thu Sep 15 12:58:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:58:39.627903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7229e94d-c5fe-4045-942e-990af6cb63b1 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] Calling method '.version_select at 0x7f62c62f34c0>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:39.851393 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7229e94d-c5fe-4045-942e-990af6cb63b1 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/459a4ad4-2976-4cc3-80fa-3cdf7ab1836c" status: 200 len: 351 microversion: 2.1 time: 0.232961 Sep 15 12:58:39.855180 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 13/18] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 12:58:39 2022] GET /compute/v2.1/os-volumes/459a4ad4-2976-4cc3-80fa-3cdf7ab1836c => generated 351 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:58:40.460085 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-de0b8dea-d88c-4b0b-a9ba-69e75c92f63b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Action: 'create', calling method: .version_select at 0x7f62c634e1f0>, body: {"keypair": {"name": "tempest-keypair-1969191459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHR1vdFARSwW7eYiY//fEUZojjS9HQYB9CsYnhZAnMurRCxf5yYpJfT9qgkR/rQxxxvDs8BhF+XEz2BohXnfWgu27kq0RFzWypmQZIIauoSflj/fdH4ES2ZF0IjH+xDwBg=="}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:58:40.546818 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-de0b8dea-d88c-4b0b-a9ba-69e75c92f63b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Getting quotas for project 27776e610cf84b49af0fec4b95aa31f3. Resources: {'key_pairs'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:58:40.563352 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-de0b8dea-d88c-4b0b-a9ba-69e75c92f63b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Getting quotas for user cff1145566f1408a9a22da9088581024 and project 27776e610cf84b49af0fec4b95aa31f3. Resources: {'key_pairs'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:58:40.610912 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-de0b8dea-d88c-4b0b-a9ba-69e75c92f63b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.514689 Sep 15 12:58:40.617181 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 6/19] 10.222.0.57 () {60 vars in 1159 bytes} [Thu Sep 15 12:58:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:58:41.657441 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9cb01734-f51e-4f48-a6ca-2c3656bc029c tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] Calling method '.version_select at 0x7f62c6343ee0>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:41.776328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9cb01734-f51e-4f48-a6ca-2c3656bc029c tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ec4b6d30-a67d-4ee6-973b-b83ef337d952" status: 200 len: 351 microversion: 2.1 time: 0.135935 Sep 15 12:58:41.778016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 14/20] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 12:58:41 2022] GET /compute/v2.1/os-volumes/ec4b6d30-a67d-4ee6-973b-b83ef337d952 => generated 351 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:58:42.943847 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1538829264", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "networks": [{"uuid": "57460050-fc7b-4d9c-8842-e197dec4e8b7"}]}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:58:43.080817 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.network.neutron [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] validate_networks() for [('57460050-fc7b-4d9c-8842-e197dec4e8b7', None, None, None, None, None)] {{(pid=120634) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:58:43.644227 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ea3ecb7b-c548-4e45-90e8-49f72c26b577 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] Calling method '.version_select at 0x7f62c62fc040>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:43.823605 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ea3ecb7b-c548-4e45-90e8-49f72c26b577 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/4f1161f7-c037-4dbe-b597-7e1cbc5b3050" status: 200 len: 350 microversion: 2.1 time: 0.184107 Sep 15 12:58:43.825002 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 15/21] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 12:58:43 2022] GET /compute/v2.1/os-volumes/4f1161f7-c037-4dbe-b597-7e1cbc5b3050 => generated 350 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:58:43.840120 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-88703935-2933-4f45-b62b-e8b75ef61aa2 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] Calling method '.version_select at 0x7f62c6343c10>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:43.971390 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-88703935-2933-4f45-b62b-e8b75ef61aa2 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.137011 Sep 15 12:58:43.972230 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 16/22] 10.222.0.57 () {58 vars in 1134 bytes} [Thu Sep 15 12:58:43 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:58:43.989899 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3a70e56d-a1c8-4374-b6b8-ac3b27833ed0 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] Calling method '.version_select at 0x7f62c62f3550>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:44.104770 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3a70e56d-a1c8-4374-b6b8-ac3b27833ed0 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.121166 Sep 15 12:58:44.106083 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 17/23] 10.222.0.57 () {58 vars in 1149 bytes} [Thu Sep 15 12:58:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:58:44.126214 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-be89460e-e8a5-4737-90a3-57726e9ec41c tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] Calling method '.version_select at 0x7f62c62fa040>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:44.294264 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-be89460e-e8a5-4737-90a3-57726e9ec41c tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.177587 Sep 15 12:58:44.295244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 18/24] 10.222.0.57 () {58 vars in 1134 bytes} [Thu Sep 15 12:58:44 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:58:44.308768 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1235660437", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0e4d116-b42c-4d92-83e5-69793b91ec95"}], "security_groups": [{"name": "tempest-securitygroup--1710848715"}], "key_name": "tempest-keypair-1975026908", "user_data": "}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:58:45.003872 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.network.neutron [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] validate_networks() for [('e0e4d116-b42c-4d92-83e5-69793b91ec95', None, None, None, None, None)] {{(pid=120633) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:58:45.388216 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Flavor limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:58:45.389346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Image limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:58:45.396943 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Flavor pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:58:45.397966 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Image pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:58:45.398836 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:58:45.432909 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:45.434077 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:45.445936 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:45.447296 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:45.453436 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:45.455801 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:45.545707 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Getting quotas for project dc2cd7163bd9476891dfe836246ead22. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:58:45.559404 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Getting quotas for user 082e5aa56ac147e6a8f8c797b269ff23 and project dc2cd7163bd9476891dfe836246ead22. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:58:45.602038 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Going to run 1 instances... {{(pid=120634) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:58:45.613304 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120634) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:58:45.766878 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-df778a83-4724-4438-9569-855e00ed7a0d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.123855 Sep 15 12:58:45.787180 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 7/25] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 12:58:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:58:45.794587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fba63932-b429-48dd-b1fe-5d397bf70da8 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] Calling method '.version_select at 0x7f62c6298ca0>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:46.101999 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-fba63932-b429-48dd-b1fe-5d397bf70da8 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.311874 Sep 15 12:58:46.104082 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 8/26] 10.222.0.57 () {58 vars in 1167 bytes} [Thu Sep 15 12:58:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:58:46.120103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-07ae0659-87a7-41fa-a95b-48ae0df62832 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:46.122194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-07ae0659-87a7-41fa-a95b-48ae0df62832 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:46.669674 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-07ae0659-87a7-41fa-a95b-48ae0df62832 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:46.688548 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-07ae0659-87a7-41fa-a95b-48ae0df62832 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1215 microversion: 2.1 time: 0.582893 Sep 15 12:58:46.696375 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 9/27] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:46 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1215 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:46.702039 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5a34a1b4-a92e-4493-8bb3-cff760515e94 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] Calling method '.version_select at 0x7f62c6236d30>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:47.022231 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5a34a1b4-a92e-4493-8bb3-cff760515e94 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.323833 Sep 15 12:58:47.022954 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 10/28] 10.222.0.57 () {58 vars in 1170 bytes} [Thu Sep 15 12:58:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:58:47.791393 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4713b991-f95b-4343-b88d-5bf072728a9b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Action: 'create', calling method: .version_select at 0x7f62c6251670>, body: {"keypair": {"name": "tempest-keypair-1098287462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl02fFC5TqOBTvqk85KXBUZfvaZVQnOGfx4mYfeLp0ddVHqEXYzJHF0bz9ea5EoSc7+Orby/ugWLIqXhQpMzOqDaUmDpMilpvSHV0NyH67VDP0VZKd0iws+v2gIQsdDtA=="}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:58:47.839898 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-4713b991-f95b-4343-b88d-5bf072728a9b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Getting quotas for project 6180da28285943f7a7b0900185df6127. Resources: {'key_pairs'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:58:47.851278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-4713b991-f95b-4343-b88d-5bf072728a9b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Getting quotas for user 2f0feb7134ee408b989b398a315850fe and project 6180da28285943f7a7b0900185df6127. Resources: {'key_pairs'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:58:47.914767 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-4713b991-f95b-4343-b88d-5bf072728a9b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.890222 Sep 15 12:58:47.915899 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 11/29] 10.222.0.57 () {62 vars in 1200 bytes} [Thu Sep 15 12:58:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 892 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 15 12:58:47.928304 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-01e1ae66-550d-4d29-aaaa-bb43348a8108 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] Calling method '.version_select at 0x7f62c6251550>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:48.223916 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-01e1ae66-550d-4d29-aaaa-bb43348a8108 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.305718 Sep 15 12:58:48.224601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 12/30] 10.222.0.57 () {58 vars in 1155 bytes} [Thu Sep 15 12:58:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:48.363612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Flavor limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:58:48.364634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Image limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:58:48.365374 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Flavor pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:58:48.365948 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Image pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:58:48.366559 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:58:48.398909 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:48.401310 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:48.402980 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:48.404045 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:48.405243 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:48.407397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:48.496696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:58:48.515772 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for user cd22d2df9ced4bb0961596385854422d and project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:58:48.546918 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Going to run 1 instances... {{(pid=120633) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:58:48.556937 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:58:48.756535 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-28b2f62d-e22d-438c-953d-d0bcfda430ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.459957 Sep 15 12:58:48.757556 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 19/31] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 12:58:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 4462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:58:48.766059 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-234266457", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad7108c9-b096-48f6-8695-b73ac5e764c5"}], "security_groups": [{"name": "tempest-securitygroup--952678452"}], "key_name": "tempest-keypair-1969191459", "user_data": "}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:58:48.774309 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-143772955", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:58:48.955878 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.network.neutron [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] validate_networks() for [('5a4caedd-fe49-46e7-8d75-963bed0357f2', None, None, None, None, None)] {{(pid=120634) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:58:49.001844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.network.neutron [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] validate_networks() for [('ad7108c9-b096-48f6-8695-b73ac5e764c5', None, None, None, None, None)] {{(pid=120633) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:58:50.142525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Flavor limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:58:50.144473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Image limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:58:50.145207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Flavor pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:58:50.145756 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Image pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:58:50.146318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:58:50.168567 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:50.169986 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:50.172430 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:50.173399 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:50.174586 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:50.176902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:50.248126 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Getting quotas for project 27776e610cf84b49af0fec4b95aa31f3. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:58:50.252837 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Getting quotas for user cff1145566f1408a9a22da9088581024 and project 27776e610cf84b49af0fec4b95aa31f3. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:58:50.269378 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Going to run 1 instances... {{(pid=120633) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:58:50.271610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:58:50.382836 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cd031b5e-2bb5-41c3-b100-4b9ec0241fd6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.623778 Sep 15 12:58:50.392266 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 20/32] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 12:58:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:58:50.398340 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b03f9ade-565f-4ec8-8e55-3af949297622 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:50.399215 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b03f9ade-565f-4ec8-8e55-3af949297622 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:50.419533 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b03f9ade-565f-4ec8-8e55-3af949297622 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:50.420202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b03f9ade-565f-4ec8-8e55-3af949297622 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:50.420906 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b03f9ade-565f-4ec8-8e55-3af949297622 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:50.422269 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b03f9ade-565f-4ec8-8e55-3af949297622 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:50.423099 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b03f9ade-565f-4ec8-8e55-3af949297622 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:50.424062 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b03f9ade-565f-4ec8-8e55-3af949297622 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:50.813006 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b03f9ade-565f-4ec8-8e55-3af949297622 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:50.852048 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b03f9ade-565f-4ec8-8e55-3af949297622 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1273 microversion: 2.1 time: 0.458258 Sep 15 12:58:50.855042 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 21/33] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:50 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1273 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:50.875902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-98136567-97fc-4626-9239-109033b16e77 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] Calling method '.version_select at 0x7f62c59a3f70>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:51.170830 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-98136567-97fc-4626-9239-109033b16e77 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.309785 Sep 15 12:58:51.171395 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 22/34] 10.222.0.57 () {58 vars in 1188 bytes} [Thu Sep 15 12:58:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:58:51.176549 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-07df3a6c-b7a3-42f5-875f-bde0166e326b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:51.184753 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-07df3a6c-b7a3-42f5-875f-bde0166e326b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:51.202967 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-07df3a6c-b7a3-42f5-875f-bde0166e326b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:51.204352 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-07df3a6c-b7a3-42f5-875f-bde0166e326b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:51.206179 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-07df3a6c-b7a3-42f5-875f-bde0166e326b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:51.212120 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-07df3a6c-b7a3-42f5-875f-bde0166e326b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:51.214244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-07df3a6c-b7a3-42f5-875f-bde0166e326b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:51.215533 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-07df3a6c-b7a3-42f5-875f-bde0166e326b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:51.375684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-07df3a6c-b7a3-42f5-875f-bde0166e326b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:51.388000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-07df3a6c-b7a3-42f5-875f-bde0166e326b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1294 microversion: 2.1 time: 0.212118 Sep 15 12:58:51.388394 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 23/35] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:51 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1294 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:51.396461 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d821e5a5-01cf-4c71-9be4-54ec82e7ce14 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:51.397141 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d821e5a5-01cf-4c71-9be4-54ec82e7ce14 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:51.616716 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d821e5a5-01cf-4c71-9be4-54ec82e7ce14 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:51.672643 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d821e5a5-01cf-4c71-9be4-54ec82e7ce14 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1237 microversion: 2.1 time: 0.276907 Sep 15 12:58:51.699465 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 24/36] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:51 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1237 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:51.699465 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e8a36096-31d7-4e43-81ba-58243dbdd305 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] Calling method '.version_select at 0x7f62c59a3ee0>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:51.903777 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Flavor limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:58:51.904868 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Image limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:58:51.905504 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Flavor pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:58:51.906075 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Image pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:58:51.906828 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:58:51.952318 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:51.952778 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:51.954596 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:51.955825 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:51.961151 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:51.961848 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:52.048242 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Getting quotas for project ffff4b9feef3437cb5529aeaaacc3f86. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:58:52.060072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Getting quotas for user e2ef1277bf944722aa33077985fb4734 and project ffff4b9feef3437cb5529aeaaacc3f86. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:58:52.085926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e8a36096-31d7-4e43-81ba-58243dbdd305 tempest-VolumesTestJSON-1647243327 tempest-VolumesTestJSON-1647243327-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.408027 Sep 15 12:58:52.086494 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 25/37] 10.222.0.57 () {58 vars in 1155 bytes} [Thu Sep 15 12:58:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:52.092711 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-de66c447-f690-4edb-8a4c-8caa9c2cf8cf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:52.093716 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-de66c447-f690-4edb-8a4c-8caa9c2cf8cf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:52.111468 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Going to run 1 instances... {{(pid=120634) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:58:52.115403 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120634) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:58:52.119528 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-de66c447-f690-4edb-8a4c-8caa9c2cf8cf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:52.120101 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-de66c447-f690-4edb-8a4c-8caa9c2cf8cf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:52.120623 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-de66c447-f690-4edb-8a4c-8caa9c2cf8cf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:52.121369 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-de66c447-f690-4edb-8a4c-8caa9c2cf8cf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:52.122159 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-de66c447-f690-4edb-8a4c-8caa9c2cf8cf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:52.122253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-de66c447-f690-4edb-8a4c-8caa9c2cf8cf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:52.305048 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-64d94aaf-0b24-4dbe-9eef-096279d01dad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.075145 Sep 15 12:58:52.325864 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 13/38] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 12:58:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 4100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:58:52.334099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-17179aa1-5bc5-470e-8066-987855c7a04f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:52.334832 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-17179aa1-5bc5-470e-8066-987855c7a04f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:52.396226 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-de66c447-f690-4edb-8a4c-8caa9c2cf8cf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:52.417818 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-de66c447-f690-4edb-8a4c-8caa9c2cf8cf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1273 microversion: 2.1 time: 0.330022 Sep 15 12:58:52.418411 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 26/39] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:52 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1273 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:52.437729 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a5ae5d2c-6105-4444-9c65-a96fc20f318d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:52.465623 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a5ae5d2c-6105-4444-9c65-a96fc20f318d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:52.504911 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5ae5d2c-6105-4444-9c65-a96fc20f318d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:52.514399 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5ae5d2c-6105-4444-9c65-a96fc20f318d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:52.518604 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5ae5d2c-6105-4444-9c65-a96fc20f318d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:52.521794 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5ae5d2c-6105-4444-9c65-a96fc20f318d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:52.522543 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5ae5d2c-6105-4444-9c65-a96fc20f318d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:52.528156 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5ae5d2c-6105-4444-9c65-a96fc20f318d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:52.851795 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a5ae5d2c-6105-4444-9c65-a96fc20f318d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:52.890244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a5ae5d2c-6105-4444-9c65-a96fc20f318d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1300 microversion: 2.1 time: 0.456733 Sep 15 12:58:52.894983 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 27/40] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:52 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1300 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:52.938992 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-dbd2c2c4-d214-4a6b-8b83-08b03635e01f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:52.940403 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-dbd2c2c4-d214-4a6b-8b83-08b03635e01f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:52.971854 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-17179aa1-5bc5-470e-8066-987855c7a04f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:52.980885 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dbd2c2c4-d214-4a6b-8b83-08b03635e01f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:52.981763 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dbd2c2c4-d214-4a6b-8b83-08b03635e01f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:52.984079 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dbd2c2c4-d214-4a6b-8b83-08b03635e01f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:52.985063 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dbd2c2c4-d214-4a6b-8b83-08b03635e01f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:52.988646 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dbd2c2c4-d214-4a6b-8b83-08b03635e01f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:52.994565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dbd2c2c4-d214-4a6b-8b83-08b03635e01f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:53.007506 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-17179aa1-5bc5-470e-8066-987855c7a04f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1221 microversion: 2.1 time: 0.680373 Sep 15 12:58:53.012075 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 14/41] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:52 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1221 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:53.374312 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-dbd2c2c4-d214-4a6b-8b83-08b03635e01f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:53.385084 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-dbd2c2c4-d214-4a6b-8b83-08b03635e01f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1289 microversion: 2.1 time: 0.461621 Sep 15 12:58:53.401226 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 28/42] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:52 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1289 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:53.435184 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-836929784", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:58:53.455648 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bdb45943-eace-47c4-b862-aa4bd0dee138 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:53.455648 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-bdb45943-eace-47c4-b862-aa4bd0dee138 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:53.473268 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bdb45943-eace-47c4-b862-aa4bd0dee138 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:53.478305 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bdb45943-eace-47c4-b862-aa4bd0dee138 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:53.478766 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bdb45943-eace-47c4-b862-aa4bd0dee138 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:53.483629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bdb45943-eace-47c4-b862-aa4bd0dee138 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:53.484574 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bdb45943-eace-47c4-b862-aa4bd0dee138 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:53.486018 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bdb45943-eace-47c4-b862-aa4bd0dee138 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:53.609801 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.network.neutron [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] validate_networks() for [('5a4caedd-fe49-46e7-8d75-963bed0357f2', None, None, None, None, None)] {{(pid=120634) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:58:53.706092 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-bdb45943-eace-47c4-b862-aa4bd0dee138 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:53.718371 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-bdb45943-eace-47c4-b862-aa4bd0dee138 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1273 microversion: 2.1 time: 0.273185 Sep 15 12:58:53.732644 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 29/43] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:53 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1273 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:58:53.929848 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-73972b0f-2035-4514-b665-7132b5b9acad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:53.930777 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-73972b0f-2035-4514-b665-7132b5b9acad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:53.941670 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-73972b0f-2035-4514-b665-7132b5b9acad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:53.942636 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-73972b0f-2035-4514-b665-7132b5b9acad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:53.943924 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-73972b0f-2035-4514-b665-7132b5b9acad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:53.945177 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-73972b0f-2035-4514-b665-7132b5b9acad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:53.945983 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-73972b0f-2035-4514-b665-7132b5b9acad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:53.948837 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-73972b0f-2035-4514-b665-7132b5b9acad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:54.074444 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-73972b0f-2035-4514-b665-7132b5b9acad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:54.090091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-73972b0f-2035-4514-b665-7132b5b9acad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1300 microversion: 2.1 time: 0.164329 Sep 15 12:58:54.099837 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 30/44] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:53 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1300 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:58:54.412559 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f395ef57-eedc-401d-94d7-06dbee49e050 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:54.413244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f395ef57-eedc-401d-94d7-06dbee49e050 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:54.425493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f395ef57-eedc-401d-94d7-06dbee49e050 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:54.425993 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f395ef57-eedc-401d-94d7-06dbee49e050 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:54.426429 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f395ef57-eedc-401d-94d7-06dbee49e050 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:54.427129 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f395ef57-eedc-401d-94d7-06dbee49e050 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:54.429101 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f395ef57-eedc-401d-94d7-06dbee49e050 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:54.429800 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f395ef57-eedc-401d-94d7-06dbee49e050 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:54.529477 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f395ef57-eedc-401d-94d7-06dbee49e050 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:54.545109 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f395ef57-eedc-401d-94d7-06dbee49e050 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1289 microversion: 2.1 time: 0.136561 Sep 15 12:58:54.545887 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 31/45] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:54 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1289 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:58:54.750889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-71188eaf-1420-4c63-affa-db9bb91177f0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:54.751500 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-71188eaf-1420-4c63-affa-db9bb91177f0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:54.767432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71188eaf-1420-4c63-affa-db9bb91177f0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:54.772592 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71188eaf-1420-4c63-affa-db9bb91177f0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:54.773426 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71188eaf-1420-4c63-affa-db9bb91177f0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:54.778101 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71188eaf-1420-4c63-affa-db9bb91177f0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:54.780350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71188eaf-1420-4c63-affa-db9bb91177f0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:54.781085 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71188eaf-1420-4c63-affa-db9bb91177f0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:54.990105 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-71188eaf-1420-4c63-affa-db9bb91177f0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:55.009049 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-71188eaf-1420-4c63-affa-db9bb91177f0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1273 microversion: 2.1 time: 0.261791 Sep 15 12:58:55.012436 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 32/46] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:54 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1273 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:55.027621 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-722252690", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47875655-3272-49b9-a3bb-38bf6ec7a8c6"}], "security_groups": [{"name": "tempest-securitygroup--1539659702"}], "key_name": "tempest-keypair-1098287462", "user_data": "}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:58:55.225715 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.network.neutron [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] validate_networks() for [('47875655-3272-49b9-a3bb-38bf6ec7a8c6', None, None, None, None, None)] {{(pid=120633) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:58:55.397414 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Flavor limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:58:55.397905 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Image limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:58:55.398711 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Flavor pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:58:55.399423 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Image pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:58:55.402385 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:58:55.428944 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:55.429558 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:55.430243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:55.431250 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:55.433590 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:55.434518 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:55.487675 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Getting quotas for project ffff4b9feef3437cb5529aeaaacc3f86. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:58:55.500812 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Getting quotas for user e2ef1277bf944722aa33077985fb4734 and project ffff4b9feef3437cb5529aeaaacc3f86. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:58:55.528809 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Going to run 1 instances... {{(pid=120634) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:58:55.531889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120634) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:58:55.620762 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-415dc35b-9c15-4a3c-a20d-c7a601818a6d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.190526 Sep 15 12:58:55.622830 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 15/47] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 12:58:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:58:55.633634 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ec53b974-66ec-4717-a74c-7ccc9ef0578c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:55.645473 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ec53b974-66ec-4717-a74c-7ccc9ef0578c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:55.659017 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ec53b974-66ec-4717-a74c-7ccc9ef0578c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:55.659897 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ec53b974-66ec-4717-a74c-7ccc9ef0578c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:55.660618 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ec53b974-66ec-4717-a74c-7ccc9ef0578c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:55.662153 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ec53b974-66ec-4717-a74c-7ccc9ef0578c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:55.663412 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ec53b974-66ec-4717-a74c-7ccc9ef0578c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:55.664885 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ec53b974-66ec-4717-a74c-7ccc9ef0578c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:55.938585 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ec53b974-66ec-4717-a74c-7ccc9ef0578c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:55.967366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ec53b974-66ec-4717-a74c-7ccc9ef0578c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1300 microversion: 2.1 time: 0.341980 Sep 15 12:58:55.969381 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 16/48] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:55 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1300 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:55.979675 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f6290a67-db67-480d-885a-ed0c7782cefe tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:55.983993 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f6290a67-db67-480d-885a-ed0c7782cefe tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:55.997871 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f6290a67-db67-480d-885a-ed0c7782cefe tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:56.000021 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f6290a67-db67-480d-885a-ed0c7782cefe tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:56.001700 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f6290a67-db67-480d-885a-ed0c7782cefe tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:56.002596 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f6290a67-db67-480d-885a-ed0c7782cefe tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:56.004755 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f6290a67-db67-480d-885a-ed0c7782cefe tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:56.006200 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f6290a67-db67-480d-885a-ed0c7782cefe tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:56.027306 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Flavor limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:58:56.027851 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Image limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:58:56.028177 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Flavor pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:58:56.028828 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Image pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:58:56.029247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:58:56.042626 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:56.043370 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:56.043993 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:56.045028 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:56.045655 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:56.046369 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:56.067073 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Getting quotas for project 6180da28285943f7a7b0900185df6127. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:58:56.071679 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Getting quotas for user 2f0feb7134ee408b989b398a315850fe and project 6180da28285943f7a7b0900185df6127. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:58:56.087912 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Going to run 1 instances... {{(pid=120633) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:58:56.091084 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:58:56.145857 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f6290a67-db67-480d-885a-ed0c7782cefe tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:56.158610 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f6290a67-db67-480d-885a-ed0c7782cefe tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1289 microversion: 2.1 time: 0.187848 Sep 15 12:58:56.159608 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 17/49] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:55 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1289 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:56.171715 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e05cba34-c053-447d-a6eb-66c4382c7a2d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.153483 Sep 15 12:58:56.173158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 33/50] 10.222.0.57 () {62 vars in 1188 bytes} [Thu Sep 15 12:58:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 15 12:58:56.184961 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-660f0544-b1cf-4c48-96dc-8c4d97ad4611 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:56.186012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-660f0544-b1cf-4c48-96dc-8c4d97ad4611 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:56.186300 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7500597f-02af-49a1-9951-ac961db2ce77 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:56.187170 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7500597f-02af-49a1-9951-ac961db2ce77 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:56.196931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7500597f-02af-49a1-9951-ac961db2ce77 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:56.197660 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7500597f-02af-49a1-9951-ac961db2ce77 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:56.198269 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7500597f-02af-49a1-9951-ac961db2ce77 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:56.199261 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7500597f-02af-49a1-9951-ac961db2ce77 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:56.201084 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7500597f-02af-49a1-9951-ac961db2ce77 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:56.201553 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:56.203073 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7500597f-02af-49a1-9951-ac961db2ce77 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:56.331033 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-660f0544-b1cf-4c48-96dc-8c4d97ad4611 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:56.341567 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-660f0544-b1cf-4c48-96dc-8c4d97ad4611 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1221 microversion: 2.1 time: 0.170064 Sep 15 12:58:56.343455 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 18/51] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:56 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:56.350700 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ea1af470-fd94-45a0-b3ca-384c81ba2d5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:56.352156 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ea1af470-fd94-45a0-b3ca-384c81ba2d5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:56.476948 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ea1af470-fd94-45a0-b3ca-384c81ba2d5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:56.488892 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ea1af470-fd94-45a0-b3ca-384c81ba2d5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:56.498300 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ea1af470-fd94-45a0-b3ca-384c81ba2d5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:56.502528 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ea1af470-fd94-45a0-b3ca-384c81ba2d5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1281 microversion: 2.20 time: 0.154610 Sep 15 12:58:56.503154 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 19/52] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:58:56 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1281 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:58:56.572739 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7500597f-02af-49a1-9951-ac961db2ce77 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:56.584652 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7500597f-02af-49a1-9951-ac961db2ce77 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 0.408190 Sep 15 12:58:56.600434 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 34/53] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:56 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:56.998836 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b7f6a599-9804-4cc3-ba9e-351c1508a01e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:56.999986 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b7f6a599-9804-4cc3-ba9e-351c1508a01e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:57.054941 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b7f6a599-9804-4cc3-ba9e-351c1508a01e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:57.058114 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b7f6a599-9804-4cc3-ba9e-351c1508a01e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:57.060980 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b7f6a599-9804-4cc3-ba9e-351c1508a01e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:57.065197 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b7f6a599-9804-4cc3-ba9e-351c1508a01e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:57.083163 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b7f6a599-9804-4cc3-ba9e-351c1508a01e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:57.086013 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b7f6a599-9804-4cc3-ba9e-351c1508a01e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:57.196435 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4aff9a48-67b4-4ae7-a1c8-491607fabe42 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:57.198453 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-4aff9a48-67b4-4ae7-a1c8-491607fabe42 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:57.242704 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4aff9a48-67b4-4ae7-a1c8-491607fabe42 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:57.245777 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4aff9a48-67b4-4ae7-a1c8-491607fabe42 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:57.249134 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4aff9a48-67b4-4ae7-a1c8-491607fabe42 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:57.256694 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4aff9a48-67b4-4ae7-a1c8-491607fabe42 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:57.257572 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4aff9a48-67b4-4ae7-a1c8-491607fabe42 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:57.263961 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4aff9a48-67b4-4ae7-a1c8-491607fabe42 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:57.580390 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4aff9a48-67b4-4ae7-a1c8-491607fabe42 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:57.606423 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b7f6a599-9804-4cc3-ba9e-351c1508a01e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:57.615986 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-4aff9a48-67b4-4ae7-a1c8-491607fabe42 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1297 microversion: 2.1 time: 0.427359 Sep 15 12:58:57.618245 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 35/54] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:57 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1297 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:58:57.621666 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b7f6a599-9804-4cc3-ba9e-351c1508a01e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1300 microversion: 2.1 time: 0.629855 Sep 15 12:58:57.622329 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 20/55] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:56 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1300 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:57.637791 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a626d29c-18c3-476e-8564-9cb2224f4a6b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:57.639490 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a626d29c-18c3-476e-8564-9cb2224f4a6b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:57.655078 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f8e2461a-4c4e-4bd5-9eab-d0a441af73ad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:57.656254 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f8e2461a-4c4e-4bd5-9eab-d0a441af73ad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:57.658769 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a626d29c-18c3-476e-8564-9cb2224f4a6b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:57.659412 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a626d29c-18c3-476e-8564-9cb2224f4a6b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:57.659857 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a626d29c-18c3-476e-8564-9cb2224f4a6b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:57.660593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a626d29c-18c3-476e-8564-9cb2224f4a6b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:57.663304 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a626d29c-18c3-476e-8564-9cb2224f4a6b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:57.663956 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a626d29c-18c3-476e-8564-9cb2224f4a6b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:57.693695 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f8e2461a-4c4e-4bd5-9eab-d0a441af73ad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:57.694599 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f8e2461a-4c4e-4bd5-9eab-d0a441af73ad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:57.696493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f8e2461a-4c4e-4bd5-9eab-d0a441af73ad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:57.704714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f8e2461a-4c4e-4bd5-9eab-d0a441af73ad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:57.705748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f8e2461a-4c4e-4bd5-9eab-d0a441af73ad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:57.706987 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f8e2461a-4c4e-4bd5-9eab-d0a441af73ad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:57.893606 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a626d29c-18c3-476e-8564-9cb2224f4a6b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:57.910132 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a626d29c-18c3-476e-8564-9cb2224f4a6b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:57.912527 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a626d29c-18c3-476e-8564-9cb2224f4a6b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:57.922470 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a626d29c-18c3-476e-8564-9cb2224f4a6b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1285 microversion: 2.20 time: 0.291875 Sep 15 12:58:57.923680 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 21/56] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:58:57 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1285 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:58:57.940557 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8e132f33-5f4d-433d-a9da-60c14633de5e tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:57.943198 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8e132f33-5f4d-433d-a9da-60c14633de5e tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:57.972156 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8e132f33-5f4d-433d-a9da-60c14633de5e tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:57.972690 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8e132f33-5f4d-433d-a9da-60c14633de5e tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:57.973132 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8e132f33-5f4d-433d-a9da-60c14633de5e tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:57.973849 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8e132f33-5f4d-433d-a9da-60c14633de5e tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:57.974308 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8e132f33-5f4d-433d-a9da-60c14633de5e tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:57.981072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8e132f33-5f4d-433d-a9da-60c14633de5e tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:58.835874 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f8e2461a-4c4e-4bd5-9eab-d0a441af73ad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:58.856856 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f8e2461a-4c4e-4bd5-9eab-d0a441af73ad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1225 microversion: 2.1 time: 1.212435 Sep 15 12:58:58.861001 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 36/57] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:57 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1225 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:58.877216 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-02dce90f-017f-4e0d-8f80-119f943f4d3e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:58.878042 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-02dce90f-017f-4e0d-8f80-119f943f4d3e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:58.888740 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-02dce90f-017f-4e0d-8f80-119f943f4d3e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:58.889237 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-02dce90f-017f-4e0d-8f80-119f943f4d3e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:58.889678 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-02dce90f-017f-4e0d-8f80-119f943f4d3e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:58.890437 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-02dce90f-017f-4e0d-8f80-119f943f4d3e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:58.890900 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-02dce90f-017f-4e0d-8f80-119f943f4d3e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:58.891324 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-02dce90f-017f-4e0d-8f80-119f943f4d3e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:59.101611 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-02dce90f-017f-4e0d-8f80-119f943f4d3e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:59.120123 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-02dce90f-017f-4e0d-8f80-119f943f4d3e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1295 microversion: 2.1 time: 0.257002 Sep 15 12:58:59.133879 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 37/58] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:58 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1295 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:59.161748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-73e71cce-8846-4242-933c-36b580b78dad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:59.162528 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-73e71cce-8846-4242-933c-36b580b78dad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:59.198545 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-73e71cce-8846-4242-933c-36b580b78dad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:59.203299 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-73e71cce-8846-4242-933c-36b580b78dad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:59.204429 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-73e71cce-8846-4242-933c-36b580b78dad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:59.207933 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-73e71cce-8846-4242-933c-36b580b78dad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:59.209725 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-73e71cce-8846-4242-933c-36b580b78dad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:59.210177 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-73e71cce-8846-4242-933c-36b580b78dad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:59.309278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8e132f33-5f4d-433d-a9da-60c14633de5e tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:59.326315 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8e132f33-5f4d-433d-a9da-60c14633de5e tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 1.400729 Sep 15 12:58:59.327240 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 22/59] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:57 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:59.349028 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8a911709-9576-4925-a505-f07d7b2b7a44 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:59.349803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8a911709-9576-4925-a505-f07d7b2b7a44 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:59.376669 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8a911709-9576-4925-a505-f07d7b2b7a44 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:59.380724 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8a911709-9576-4925-a505-f07d7b2b7a44 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:59.381659 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8a911709-9576-4925-a505-f07d7b2b7a44 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:59.382894 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8a911709-9576-4925-a505-f07d7b2b7a44 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:59.383750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8a911709-9576-4925-a505-f07d7b2b7a44 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:59.393017 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8a911709-9576-4925-a505-f07d7b2b7a44 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:59.403771 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-73e71cce-8846-4242-933c-36b580b78dad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:59.413044 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-73e71cce-8846-4242-933c-36b580b78dad tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1300 microversion: 2.1 time: 0.265796 Sep 15 12:58:59.416191 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 38/60] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:59 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1300 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:58:59.883214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8a911709-9576-4925-a505-f07d7b2b7a44 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:59.884772 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-1b182187-5325-42b0-9a32-9737387eb843 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:58:59.886655 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-1b182187-5325-42b0-9a32-9737387eb843 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:58:59.898491 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8a911709-9576-4925-a505-f07d7b2b7a44 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:59.900265 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8a911709-9576-4925-a505-f07d7b2b7a44 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:58:59.907420 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1b182187-5325-42b0-9a32-9737387eb843 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:59.909947 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1b182187-5325-42b0-9a32-9737387eb843 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:59.910413 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1b182187-5325-42b0-9a32-9737387eb843 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:59.914704 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1b182187-5325-42b0-9a32-9737387eb843 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:58:59.914974 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8a911709-9576-4925-a505-f07d7b2b7a44 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1277 microversion: 2.20 time: 0.584868 Sep 15 12:58:59.915192 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1b182187-5325-42b0-9a32-9737387eb843 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:58:59.915697 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1b182187-5325-42b0-9a32-9737387eb843 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:58:59.934630 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 23/61] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:58:59 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1277 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:00.153633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1bd8c306-88b7-4795-8fc1-8b807b890a28 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:00.154450 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1bd8c306-88b7-4795-8fc1-8b807b890a28 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:00.185975 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1bd8c306-88b7-4795-8fc1-8b807b890a28 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:00.187363 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1bd8c306-88b7-4795-8fc1-8b807b890a28 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:00.191483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1bd8c306-88b7-4795-8fc1-8b807b890a28 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:00.219456 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1bd8c306-88b7-4795-8fc1-8b807b890a28 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:00.224225 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1bd8c306-88b7-4795-8fc1-8b807b890a28 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:00.228779 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1bd8c306-88b7-4795-8fc1-8b807b890a28 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:00.730456 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1bd8c306-88b7-4795-8fc1-8b807b890a28 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:00.750022 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1bd8c306-88b7-4795-8fc1-8b807b890a28 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1295 microversion: 2.1 time: 0.599702 Sep 15 12:59:00.753124 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 24/62] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:00 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1295 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:00.768692 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d81fb80b-8a37-4161-82db-8f2351d2342d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:00.772499 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d81fb80b-8a37-4161-82db-8f2351d2342d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:00.796289 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d81fb80b-8a37-4161-82db-8f2351d2342d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:00.800568 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d81fb80b-8a37-4161-82db-8f2351d2342d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:00.805313 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d81fb80b-8a37-4161-82db-8f2351d2342d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:00.809568 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d81fb80b-8a37-4161-82db-8f2351d2342d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:00.810845 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d81fb80b-8a37-4161-82db-8f2351d2342d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:00.813649 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d81fb80b-8a37-4161-82db-8f2351d2342d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:00.925458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-1b182187-5325-42b0-9a32-9737387eb843 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:00.936671 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-1b182187-5325-42b0-9a32-9737387eb843 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1217 microversion: 2.1 time: 1.057076 Sep 15 12:59:00.971604 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 39/63] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:58:59 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1217 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:00.983092 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-171483a8-c3aa-461c-b13d-7a0bc630ee5d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:00.985361 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-171483a8-c3aa-461c-b13d-7a0bc630ee5d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:01.013855 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-171483a8-c3aa-461c-b13d-7a0bc630ee5d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:01.018404 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-171483a8-c3aa-461c-b13d-7a0bc630ee5d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:01.018926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-171483a8-c3aa-461c-b13d-7a0bc630ee5d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:01.019788 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-171483a8-c3aa-461c-b13d-7a0bc630ee5d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:01.020569 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-171483a8-c3aa-461c-b13d-7a0bc630ee5d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:01.021243 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-171483a8-c3aa-461c-b13d-7a0bc630ee5d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:01.067165 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=100 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:01.589617 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-171483a8-c3aa-461c-b13d-7a0bc630ee5d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:01.611780 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-171483a8-c3aa-461c-b13d-7a0bc630ee5d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.637120 Sep 15 12:59:01.614253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 40/64] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:00 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:01.628984 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-6de96657-a5d8-40bf-a6c0-d8188b72d10c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:01.629609 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-6de96657-a5d8-40bf-a6c0-d8188b72d10c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:01.645565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6de96657-a5d8-40bf-a6c0-d8188b72d10c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:01.646215 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6de96657-a5d8-40bf-a6c0-d8188b72d10c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:01.647825 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6de96657-a5d8-40bf-a6c0-d8188b72d10c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:01.649426 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6de96657-a5d8-40bf-a6c0-d8188b72d10c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:01.651092 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6de96657-a5d8-40bf-a6c0-d8188b72d10c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:01.651546 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6de96657-a5d8-40bf-a6c0-d8188b72d10c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:01.896981 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d81fb80b-8a37-4161-82db-8f2351d2342d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:01.910101 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d81fb80b-8a37-4161-82db-8f2351d2342d tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 1.154350 Sep 15 12:59:01.915343 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 25/65] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:00 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:01.933890 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0a57195b-6e53-45fc-bd82-004afb28aea8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:01.934936 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0a57195b-6e53-45fc-bd82-004afb28aea8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:01.951067 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a57195b-6e53-45fc-bd82-004afb28aea8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:01.959797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a57195b-6e53-45fc-bd82-004afb28aea8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:01.961468 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a57195b-6e53-45fc-bd82-004afb28aea8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:01.964255 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a57195b-6e53-45fc-bd82-004afb28aea8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:01.965701 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a57195b-6e53-45fc-bd82-004afb28aea8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:01.967560 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a57195b-6e53-45fc-bd82-004afb28aea8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:02.112104 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-6de96657-a5d8-40bf-a6c0-d8188b72d10c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:02.124091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-6de96657-a5d8-40bf-a6c0-d8188b72d10c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:02.130092 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-6de96657-a5d8-40bf-a6c0-d8188b72d10c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:02.131419 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-6de96657-a5d8-40bf-a6c0-d8188b72d10c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1277 microversion: 2.20 time: 0.515965 Sep 15 12:59:02.153894 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 41/66] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:01 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1277 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:02.163506 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-88215cc5-40cd-4b04-b68f-8fa3e3607697 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:02.169327 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-88215cc5-40cd-4b04-b68f-8fa3e3607697 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:02.178135 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-88215cc5-40cd-4b04-b68f-8fa3e3607697 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:02.181570 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-88215cc5-40cd-4b04-b68f-8fa3e3607697 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:02.184376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-88215cc5-40cd-4b04-b68f-8fa3e3607697 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:02.185564 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-88215cc5-40cd-4b04-b68f-8fa3e3607697 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:02.186315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-88215cc5-40cd-4b04-b68f-8fa3e3607697 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:02.187608 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-88215cc5-40cd-4b04-b68f-8fa3e3607697 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:02.590411 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0a57195b-6e53-45fc-bd82-004afb28aea8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:02.598684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0a57195b-6e53-45fc-bd82-004afb28aea8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1295 microversion: 2.1 time: 0.680419 Sep 15 12:59:02.603650 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 26/67] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:01 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1295 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:02.649301 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6308d415-74cb-4277-934c-a2494d22a7cb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:02.649301 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6308d415-74cb-4277-934c-a2494d22a7cb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:02.657352 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6308d415-74cb-4277-934c-a2494d22a7cb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:02.658087 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6308d415-74cb-4277-934c-a2494d22a7cb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:02.659774 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6308d415-74cb-4277-934c-a2494d22a7cb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:02.662157 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6308d415-74cb-4277-934c-a2494d22a7cb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:02.662780 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6308d415-74cb-4277-934c-a2494d22a7cb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:02.663381 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6308d415-74cb-4277-934c-a2494d22a7cb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:02.971736 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-88215cc5-40cd-4b04-b68f-8fa3e3607697 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:02.984200 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-88215cc5-40cd-4b04-b68f-8fa3e3607697 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1281 microversion: 2.1 time: 0.824647 Sep 15 12:59:02.987301 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 42/68] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:02 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1281 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:03.000018 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a5adc529-c284-4ae5-a5e4-dcc81aa50036 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:03.003083 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a5adc529-c284-4ae5-a5e4-dcc81aa50036 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:03.017460 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5adc529-c284-4ae5-a5e4-dcc81aa50036 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:03.022709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5adc529-c284-4ae5-a5e4-dcc81aa50036 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:03.023410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5adc529-c284-4ae5-a5e4-dcc81aa50036 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:03.024392 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5adc529-c284-4ae5-a5e4-dcc81aa50036 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:03.026266 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5adc529-c284-4ae5-a5e4-dcc81aa50036 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:03.026654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5adc529-c284-4ae5-a5e4-dcc81aa50036 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:03.468028 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6308d415-74cb-4277-934c-a2494d22a7cb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:03.484771 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6308d415-74cb-4277-934c-a2494d22a7cb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.846460 Sep 15 12:59:03.508732 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 27/69] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:02 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:03.527706 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8da573ee-25e6-406b-9da5-04dc336b429d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:03.533784 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8da573ee-25e6-406b-9da5-04dc336b429d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:03.562931 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8da573ee-25e6-406b-9da5-04dc336b429d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:03.563440 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8da573ee-25e6-406b-9da5-04dc336b429d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:03.563882 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8da573ee-25e6-406b-9da5-04dc336b429d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:03.569663 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8da573ee-25e6-406b-9da5-04dc336b429d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:03.581004 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8da573ee-25e6-406b-9da5-04dc336b429d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:03.581598 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8da573ee-25e6-406b-9da5-04dc336b429d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:04.097392 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a5adc529-c284-4ae5-a5e4-dcc81aa50036 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:04.110631 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a5adc529-c284-4ae5-a5e4-dcc81aa50036 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 1.117936 Sep 15 12:59:04.111367 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 43/70] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:02 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:04.130036 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-418e1330-7038-45da-bf10-ebb333a73132 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:04.130887 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-418e1330-7038-45da-bf10-ebb333a73132 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:04.145279 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-418e1330-7038-45da-bf10-ebb333a73132 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:04.148510 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-418e1330-7038-45da-bf10-ebb333a73132 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:04.152016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-418e1330-7038-45da-bf10-ebb333a73132 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:04.156398 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-418e1330-7038-45da-bf10-ebb333a73132 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:04.157268 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-418e1330-7038-45da-bf10-ebb333a73132 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:04.158040 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-418e1330-7038-45da-bf10-ebb333a73132 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:04.193738 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8da573ee-25e6-406b-9da5-04dc336b429d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:04.207097 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8da573ee-25e6-406b-9da5-04dc336b429d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:04.213018 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8da573ee-25e6-406b-9da5-04dc336b429d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:04.216228 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8da573ee-25e6-406b-9da5-04dc336b429d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1341 microversion: 2.20 time: 0.705370 Sep 15 12:59:04.232455 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 28/71] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:03 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1341 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:04.383736 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-0506e851-4b79-41eb-b462-7f6a2cbb0e07 req-9b39d252-364c-47fa-a8b0-6ec13efddcf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fd7739a-69fe-4204-be18-f21e623d0992", "tag": "e1b7b694-7f38-474e-8781-153677c9fb5b"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:04.457932 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-0506e851-4b79-41eb-b462-7f6a2cbb0e07 req-9b39d252-364c-47fa-a8b0-6ec13efddcf4 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:04.464166 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-0506e851-4b79-41eb-b462-7f6a2cbb0e07 req-9b39d252-364c-47fa-a8b0-6ec13efddcf4 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:04.464797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-0506e851-4b79-41eb-b462-7f6a2cbb0e07 req-9b39d252-364c-47fa-a8b0-6ec13efddcf4 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:04.556528 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-0506e851-4b79-41eb-b462-7f6a2cbb0e07 req-9b39d252-364c-47fa-a8b0-6ec13efddcf4 service nova] Creating event network-changed:e1b7b694-7f38-474e-8781-153677c9fb5b for instance 9fd7739a-69fe-4204-be18-f21e623d0992 on hv-cinder-83608 Sep 15 12:59:04.564619 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-0506e851-4b79-41eb-b462-7f6a2cbb0e07 req-9b39d252-364c-47fa-a8b0-6ec13efddcf4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120634) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 15 12:59:04.565425 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-0506e851-4b79-41eb-b462-7f6a2cbb0e07 req-9b39d252-364c-47fa-a8b0-6ec13efddcf4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120634) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 15 12:59:04.567790 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f6de66af-db33-42d4-a320-2ce6adfe7085 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:04.570001 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f6de66af-db33-42d4-a320-2ce6adfe7085 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:04.570499 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f6de66af-db33-42d4-a320-2ce6adfe7085 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:04.571338 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f6de66af-db33-42d4-a320-2ce6adfe7085 None None] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:04.577371 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f6de66af-db33-42d4-a320-2ce6adfe7085 None None] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:04.577936 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f6de66af-db33-42d4-a320-2ce6adfe7085 None None] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:04.623161 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.compute.rpcapi [None req-f6de66af-db33-42d4-a320-2ce6adfe7085 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 15 12:59:04.624169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f6de66af-db33-42d4-a320-2ce6adfe7085 None None] Releasing lock "compute-rpcapi-router" {{(pid=120634) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 15 12:59:04.673088 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f6de66af-db33-42d4-a320-2ce6adfe7085 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436862 Sep 15 12:59:04.674412 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 29/72] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:59:04.693150 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-38ec319c-a0cd-4631-9fce-789396bc42d5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:04.694131 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-38ec319c-a0cd-4631-9fce-789396bc42d5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:04.744906 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-38ec319c-a0cd-4631-9fce-789396bc42d5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:04.746155 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-38ec319c-a0cd-4631-9fce-789396bc42d5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:04.755140 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-38ec319c-a0cd-4631-9fce-789396bc42d5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:04.773669 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-38ec319c-a0cd-4631-9fce-789396bc42d5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:04.775711 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-38ec319c-a0cd-4631-9fce-789396bc42d5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:04.776772 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-38ec319c-a0cd-4631-9fce-789396bc42d5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:05.109229 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-38ec319c-a0cd-4631-9fce-789396bc42d5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:05.147950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-38ec319c-a0cd-4631-9fce-789396bc42d5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1279 microversion: 2.1 time: 0.468716 Sep 15 12:59:05.152147 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 30/73] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:04 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1279 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:05.171409 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c8cf389a-a989-4867-9c3b-8acfc981d3c2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:05.172942 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c8cf389a-a989-4867-9c3b-8acfc981d3c2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:05.194103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8cf389a-a989-4867-9c3b-8acfc981d3c2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:05.198294 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8cf389a-a989-4867-9c3b-8acfc981d3c2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:05.200019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8cf389a-a989-4867-9c3b-8acfc981d3c2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:05.202009 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8cf389a-a989-4867-9c3b-8acfc981d3c2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:05.203042 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8cf389a-a989-4867-9c3b-8acfc981d3c2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:05.209544 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8cf389a-a989-4867-9c3b-8acfc981d3c2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:05.616126 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-418e1330-7038-45da-bf10-ebb333a73132 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:05.634842 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-418e1330-7038-45da-bf10-ebb333a73132 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 1.519638 Sep 15 12:59:05.638183 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 44/74] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:04 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:05.646244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d22cb6f3-e453-460f-8774-96326349c3fe tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:05.648875 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d22cb6f3-e453-460f-8774-96326349c3fe tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:05.673799 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:05.702222 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d22cb6f3-e453-460f-8774-96326349c3fe tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:05.703755 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d22cb6f3-e453-460f-8774-96326349c3fe tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:05.708676 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d22cb6f3-e453-460f-8774-96326349c3fe tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:05.710843 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d22cb6f3-e453-460f-8774-96326349c3fe tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:05.716781 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d22cb6f3-e453-460f-8774-96326349c3fe tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:05.717654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d22cb6f3-e453-460f-8774-96326349c3fe tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:06.055209 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=6 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:06.088768 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=20 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:06.160998 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d22cb6f3-e453-460f-8774-96326349c3fe tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:06.178697 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d22cb6f3-e453-460f-8774-96326349c3fe tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 0.537886 Sep 15 12:59:06.179653 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 45/75] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:05 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:06.187983 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-780bec48-374b-4f9a-b0a2-f4094cf0a0d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:06.188728 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-780bec48-374b-4f9a-b0a2-f4094cf0a0d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:06.204635 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-780bec48-374b-4f9a-b0a2-f4094cf0a0d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:06.205219 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-780bec48-374b-4f9a-b0a2-f4094cf0a0d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:06.205663 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-780bec48-374b-4f9a-b0a2-f4094cf0a0d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:06.206410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-780bec48-374b-4f9a-b0a2-f4094cf0a0d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:06.206861 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-780bec48-374b-4f9a-b0a2-f4094cf0a0d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:06.207278 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-780bec48-374b-4f9a-b0a2-f4094cf0a0d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:06.376624 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c8cf389a-a989-4867-9c3b-8acfc981d3c2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:06.380185 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=87 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:06.394496 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c8cf389a-a989-4867-9c3b-8acfc981d3c2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 1.239924 Sep 15 12:59:06.396452 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 31/76] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:05 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:06.436850 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-be395197-143f-4859-8d92-7af1c9f6470b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:06.442274 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-be395197-143f-4859-8d92-7af1c9f6470b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:06.465049 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-780bec48-374b-4f9a-b0a2-f4094cf0a0d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:06.483572 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-780bec48-374b-4f9a-b0a2-f4094cf0a0d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:06.488155 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=38 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:06.490186 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-780bec48-374b-4f9a-b0a2-f4094cf0a0d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:06.496788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-be395197-143f-4859-8d92-7af1c9f6470b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:06.496788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-be395197-143f-4859-8d92-7af1c9f6470b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:06.498996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-780bec48-374b-4f9a-b0a2-f4094cf0a0d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1339 microversion: 2.20 time: 0.312647 Sep 15 12:59:06.499757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-be395197-143f-4859-8d92-7af1c9f6470b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:06.504920 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-be395197-143f-4859-8d92-7af1c9f6470b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:06.507096 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-be395197-143f-4859-8d92-7af1c9f6470b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:06.509753 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-be395197-143f-4859-8d92-7af1c9f6470b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:06.513903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 46/77] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:06 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1339 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:06.663779 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f9849494-82ce-4a12-b410-cbc4cc146639 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:06.664518 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f9849494-82ce-4a12-b410-cbc4cc146639 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:06.677650 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f9849494-82ce-4a12-b410-cbc4cc146639 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:06.678156 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f9849494-82ce-4a12-b410-cbc4cc146639 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:06.678598 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f9849494-82ce-4a12-b410-cbc4cc146639 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:06.691670 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f9849494-82ce-4a12-b410-cbc4cc146639 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:06.692395 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f9849494-82ce-4a12-b410-cbc4cc146639 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:06.693024 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f9849494-82ce-4a12-b410-cbc4cc146639 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:07.127836 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-be395197-143f-4859-8d92-7af1c9f6470b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:07.142864 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-be395197-143f-4859-8d92-7af1c9f6470b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1279 microversion: 2.1 time: 0.744604 Sep 15 12:59:07.144427 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 32/78] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:06 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1279 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:07.152071 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f9849494-82ce-4a12-b410-cbc4cc146639 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:07.175882 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f9849494-82ce-4a12-b410-cbc4cc146639 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.513799 Sep 15 12:59:07.213478 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 47/79] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:06 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:07.238631 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2e37f9ef-fd4a-4243-9200-f1d64ec9d9e8 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:07.239270 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2e37f9ef-fd4a-4243-9200-f1d64ec9d9e8 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:07.250240 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2e37f9ef-fd4a-4243-9200-f1d64ec9d9e8 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:07.250734 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2e37f9ef-fd4a-4243-9200-f1d64ec9d9e8 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:07.251167 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2e37f9ef-fd4a-4243-9200-f1d64ec9d9e8 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:07.252246 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2e37f9ef-fd4a-4243-9200-f1d64ec9d9e8 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:07.252726 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2e37f9ef-fd4a-4243-9200-f1d64ec9d9e8 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:07.253146 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2e37f9ef-fd4a-4243-9200-f1d64ec9d9e8 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:07.260476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-e4f6546d-e010-4a65-ae8a-67c23e70b4ac req-609f3133-1116-4608-82fb-a88593bf4a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a48c801-810d-4702-a905-a6109e4786d8", "tag": "15fae3ac-3d15-4151-bd85-4686ea0f64b1"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:07.310958 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-e4f6546d-e010-4a65-ae8a-67c23e70b4ac req-609f3133-1116-4608-82fb-a88593bf4a52 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:07.311679 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-e4f6546d-e010-4a65-ae8a-67c23e70b4ac req-609f3133-1116-4608-82fb-a88593bf4a52 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:07.315922 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-e4f6546d-e010-4a65-ae8a-67c23e70b4ac req-609f3133-1116-4608-82fb-a88593bf4a52 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:07.357692 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-e4f6546d-e010-4a65-ae8a-67c23e70b4ac req-609f3133-1116-4608-82fb-a88593bf4a52 service nova] Creating event network-changed:15fae3ac-3d15-4151-bd85-4686ea0f64b1 for instance 7a48c801-810d-4702-a905-a6109e4786d8 on hv-cinder-83608 Sep 15 12:59:07.378873 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-e4f6546d-e010-4a65-ae8a-67c23e70b4ac req-609f3133-1116-4608-82fb-a88593bf4a52 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231103 Sep 15 12:59:07.385010 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 33/80] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:59:07.428757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fe58e461-b401-4a5d-a30f-d587bbc14d82 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:07.429464 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-fe58e461-b401-4a5d-a30f-d587bbc14d82 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:07.440008 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe58e461-b401-4a5d-a30f-d587bbc14d82 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:07.443496 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe58e461-b401-4a5d-a30f-d587bbc14d82 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:07.445644 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe58e461-b401-4a5d-a30f-d587bbc14d82 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:07.447942 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe58e461-b401-4a5d-a30f-d587bbc14d82 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:07.449380 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe58e461-b401-4a5d-a30f-d587bbc14d82 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:07.451296 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe58e461-b401-4a5d-a30f-d587bbc14d82 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:08.106313 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2e37f9ef-fd4a-4243-9200-f1d64ec9d9e8 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:08.115104 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2e37f9ef-fd4a-4243-9200-f1d64ec9d9e8 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 0.900188 Sep 15 12:59:08.144681 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 48/81] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:07 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:08.150625 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a1482119-4725-4c67-8a58-ffeb18b394cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:08.151564 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a1482119-4725-4c67-8a58-ffeb18b394cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:08.157832 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a1482119-4725-4c67-8a58-ffeb18b394cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:08.162285 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a1482119-4725-4c67-8a58-ffeb18b394cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:08.162980 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a1482119-4725-4c67-8a58-ffeb18b394cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:08.164050 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a1482119-4725-4c67-8a58-ffeb18b394cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:08.164700 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a1482119-4725-4c67-8a58-ffeb18b394cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:08.169734 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a1482119-4725-4c67-8a58-ffeb18b394cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:08.314395 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a1482119-4725-4c67-8a58-ffeb18b394cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:08.324522 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a1482119-4725-4c67-8a58-ffeb18b394cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:08.326281 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a1482119-4725-4c67-8a58-ffeb18b394cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:08.327613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a1482119-4725-4c67-8a58-ffeb18b394cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1339 microversion: 2.20 time: 0.181625 Sep 15 12:59:08.328383 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 49/82] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:08 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1339 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:08.333129 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d83cf1e2-4188-4a21-9703-8ee29cc82523 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:08.334009 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d83cf1e2-4188-4a21-9703-8ee29cc82523 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:08.341447 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d83cf1e2-4188-4a21-9703-8ee29cc82523 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:08.342233 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d83cf1e2-4188-4a21-9703-8ee29cc82523 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:08.342926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d83cf1e2-4188-4a21-9703-8ee29cc82523 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:08.344312 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d83cf1e2-4188-4a21-9703-8ee29cc82523 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:08.346013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d83cf1e2-4188-4a21-9703-8ee29cc82523 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:08.346679 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d83cf1e2-4188-4a21-9703-8ee29cc82523 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:08.365463 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-fe58e461-b401-4a5d-a30f-d587bbc14d82 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:08.379648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-fe58e461-b401-4a5d-a30f-d587bbc14d82 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.955748 Sep 15 12:59:08.395683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 34/83] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:07 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:08.402873 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-de688d2f-3bf2-4e67-b8e4-650216664a16 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:08.403997 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-de688d2f-3bf2-4e67-b8e4-650216664a16 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:08.411739 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-de688d2f-3bf2-4e67-b8e4-650216664a16 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:08.412334 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-de688d2f-3bf2-4e67-b8e4-650216664a16 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:08.412835 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-de688d2f-3bf2-4e67-b8e4-650216664a16 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:08.413681 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-de688d2f-3bf2-4e67-b8e4-650216664a16 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:08.414218 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-de688d2f-3bf2-4e67-b8e4-650216664a16 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:08.414988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-de688d2f-3bf2-4e67-b8e4-650216664a16 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:08.814967 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d83cf1e2-4188-4a21-9703-8ee29cc82523 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:08.833975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d83cf1e2-4188-4a21-9703-8ee29cc82523 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.504202 Sep 15 12:59:08.837322 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 50/84] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:08 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:08.967034 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-de688d2f-3bf2-4e67-b8e4-650216664a16 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:08.982340 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-de688d2f-3bf2-4e67-b8e4-650216664a16 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.583972 Sep 15 12:59:08.996531 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 35/85] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:08 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:09.146619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-71642022-e7d1-4fc5-ae63-f4aacc160acf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:09.148885 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-71642022-e7d1-4fc5-ae63-f4aacc160acf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:09.163161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71642022-e7d1-4fc5-ae63-f4aacc160acf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:09.164757 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71642022-e7d1-4fc5-ae63-f4aacc160acf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:09.166063 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71642022-e7d1-4fc5-ae63-f4aacc160acf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:09.167405 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71642022-e7d1-4fc5-ae63-f4aacc160acf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:09.168068 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71642022-e7d1-4fc5-ae63-f4aacc160acf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:09.168857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71642022-e7d1-4fc5-ae63-f4aacc160acf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:09.357339 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2d9c95a4-f28e-49db-a546-87ca21ed985c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:09.358479 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2d9c95a4-f28e-49db-a546-87ca21ed985c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:09.367101 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2d9c95a4-f28e-49db-a546-87ca21ed985c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:09.367821 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2d9c95a4-f28e-49db-a546-87ca21ed985c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:09.368654 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2d9c95a4-f28e-49db-a546-87ca21ed985c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:09.370043 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2d9c95a4-f28e-49db-a546-87ca21ed985c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:09.370638 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2d9c95a4-f28e-49db-a546-87ca21ed985c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:09.371337 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2d9c95a4-f28e-49db-a546-87ca21ed985c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:09.539318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-71642022-e7d1-4fc5-ae63-f4aacc160acf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:09.552465 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-71642022-e7d1-4fc5-ae63-f4aacc160acf tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 0.415960 Sep 15 12:59:09.553048 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 51/86] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:09 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:09.566001 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b4651365-28a7-405c-bd12-fca65cf47a18 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:09.566814 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b4651365-28a7-405c-bd12-fca65cf47a18 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:09.573921 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4651365-28a7-405c-bd12-fca65cf47a18 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:09.574646 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4651365-28a7-405c-bd12-fca65cf47a18 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:09.575278 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4651365-28a7-405c-bd12-fca65cf47a18 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:09.577553 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4651365-28a7-405c-bd12-fca65cf47a18 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:09.578218 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4651365-28a7-405c-bd12-fca65cf47a18 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:09.578915 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4651365-28a7-405c-bd12-fca65cf47a18 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:09.749622 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2d9c95a4-f28e-49db-a546-87ca21ed985c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:09.768626 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2d9c95a4-f28e-49db-a546-87ca21ed985c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:09.774361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2d9c95a4-f28e-49db-a546-87ca21ed985c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:09.778006 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2d9c95a4-f28e-49db-a546-87ca21ed985c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.425900 Sep 15 12:59:09.801210 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 36/87] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:09 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:59:09.816434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-e5b38322-2260-42bb-a7db-48c4372982ea req-ba9df891-6f5d-4b3c-9048-9ff48a396589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7538af-56ab-4022-85eb-172a1ee55d71", "tag": "71e9592f-0e8b-403c-bbfd-bae6e0da6f5f"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:09.836772 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-e5b38322-2260-42bb-a7db-48c4372982ea req-ba9df891-6f5d-4b3c-9048-9ff48a396589 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:09.836772 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-e5b38322-2260-42bb-a7db-48c4372982ea req-ba9df891-6f5d-4b3c-9048-9ff48a396589 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:09.837306 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-e5b38322-2260-42bb-a7db-48c4372982ea req-ba9df891-6f5d-4b3c-9048-9ff48a396589 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:09.856829 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-e5b38322-2260-42bb-a7db-48c4372982ea req-ba9df891-6f5d-4b3c-9048-9ff48a396589 service nova] Creating event network-changed:71e9592f-0e8b-403c-bbfd-bae6e0da6f5f for instance 2c7538af-56ab-4022-85eb-172a1ee55d71 on hv-cinder-83608 Sep 15 12:59:09.862582 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-e5b38322-2260-42bb-a7db-48c4372982ea req-ba9df891-6f5d-4b3c-9048-9ff48a396589 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059315 Sep 15 12:59:09.863369 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 37/88] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:59:09.870685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3a7d06d6-716e-4308-8b57-e5d759cb68af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:09.871550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3a7d06d6-716e-4308-8b57-e5d759cb68af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:09.878984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a7d06d6-716e-4308-8b57-e5d759cb68af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:09.879666 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a7d06d6-716e-4308-8b57-e5d759cb68af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:09.880437 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a7d06d6-716e-4308-8b57-e5d759cb68af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:09.881798 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a7d06d6-716e-4308-8b57-e5d759cb68af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:09.882410 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a7d06d6-716e-4308-8b57-e5d759cb68af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:09.882979 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a7d06d6-716e-4308-8b57-e5d759cb68af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:09.968683 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b4651365-28a7-405c-bd12-fca65cf47a18 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:09.979119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b4651365-28a7-405c-bd12-fca65cf47a18 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.424855 Sep 15 12:59:09.980081 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 52/89] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:09 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:10.017815 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a75920e2-3ee3-45a9-93b5-5606c18973c1 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:10.018449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a75920e2-3ee3-45a9-93b5-5606c18973c1 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:10.028740 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a75920e2-3ee3-45a9-93b5-5606c18973c1 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:10.033683 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a75920e2-3ee3-45a9-93b5-5606c18973c1 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:10.037146 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a75920e2-3ee3-45a9-93b5-5606c18973c1 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:10.037972 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a75920e2-3ee3-45a9-93b5-5606c18973c1 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:10.043397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a75920e2-3ee3-45a9-93b5-5606c18973c1 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:10.045542 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a75920e2-3ee3-45a9-93b5-5606c18973c1 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:10.471595 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3a7d06d6-716e-4308-8b57-e5d759cb68af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:10.486946 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3a7d06d6-716e-4308-8b57-e5d759cb68af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.619381 Sep 15 12:59:10.488428 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 38/90] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:09 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:10.501766 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-6321f7d7-13e2-41b0-b787-a849768d7dfa req-fbf14251-3014-4ff1-9cef-6df361843a01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a7eade-1e1a-467f-a607-132c874cbb64", "tag": "c0f58aee-58a1-4953-8f6b-d92d148c0d4d"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:10.526865 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-6321f7d7-13e2-41b0-b787-a849768d7dfa req-fbf14251-3014-4ff1-9cef-6df361843a01 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:10.527349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-6321f7d7-13e2-41b0-b787-a849768d7dfa req-fbf14251-3014-4ff1-9cef-6df361843a01 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:10.527770 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-6321f7d7-13e2-41b0-b787-a849768d7dfa req-fbf14251-3014-4ff1-9cef-6df361843a01 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:10.555274 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-6321f7d7-13e2-41b0-b787-a849768d7dfa req-fbf14251-3014-4ff1-9cef-6df361843a01 service nova] Creating event network-changed:c0f58aee-58a1-4953-8f6b-d92d148c0d4d for instance f5a7eade-1e1a-467f-a607-132c874cbb64 on hv-cinder-83608 Sep 15 12:59:10.565816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-6321f7d7-13e2-41b0-b787-a849768d7dfa req-fbf14251-3014-4ff1-9cef-6df361843a01 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074938 Sep 15 12:59:10.568237 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 39/91] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:59:10.579427 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d3195495-79aa-4a7d-a153-a18f200a822f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:10.584375 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d3195495-79aa-4a7d-a153-a18f200a822f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:10.591850 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d3195495-79aa-4a7d-a153-a18f200a822f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:10.592794 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d3195495-79aa-4a7d-a153-a18f200a822f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:10.593506 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d3195495-79aa-4a7d-a153-a18f200a822f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:10.595081 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d3195495-79aa-4a7d-a153-a18f200a822f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:10.595751 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d3195495-79aa-4a7d-a153-a18f200a822f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:10.596392 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d3195495-79aa-4a7d-a153-a18f200a822f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:10.650659 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a75920e2-3ee3-45a9-93b5-5606c18973c1 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:10.662647 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a75920e2-3ee3-45a9-93b5-5606c18973c1 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.650928 Sep 15 12:59:10.666333 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 53/92] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:10 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:10.809478 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e18ab969-e97f-4426-9dee-063eedd8a71c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:10.810181 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e18ab969-e97f-4426-9dee-063eedd8a71c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:10.827157 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e18ab969-e97f-4426-9dee-063eedd8a71c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:10.830769 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e18ab969-e97f-4426-9dee-063eedd8a71c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:10.831928 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e18ab969-e97f-4426-9dee-063eedd8a71c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:10.833340 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e18ab969-e97f-4426-9dee-063eedd8a71c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:10.837573 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e18ab969-e97f-4426-9dee-063eedd8a71c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:10.841430 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e18ab969-e97f-4426-9dee-063eedd8a71c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:11.351447 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d3195495-79aa-4a7d-a153-a18f200a822f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:11.367919 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d3195495-79aa-4a7d-a153-a18f200a822f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 0.793404 Sep 15 12:59:11.368774 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 40/93] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:10 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:11.382003 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e18ab969-e97f-4426-9dee-063eedd8a71c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:11.396135 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c06c2636-44a2-48f2-bb7f-2d02300f63fa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:11.396869 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c06c2636-44a2-48f2-bb7f-2d02300f63fa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:11.401702 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e18ab969-e97f-4426-9dee-063eedd8a71c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:11.406569 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e18ab969-e97f-4426-9dee-063eedd8a71c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:11.408118 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e18ab969-e97f-4426-9dee-063eedd8a71c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.603596 Sep 15 12:59:11.408955 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 54/94] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:10 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:59:11.419876 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c06c2636-44a2-48f2-bb7f-2d02300f63fa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:11.423044 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c06c2636-44a2-48f2-bb7f-2d02300f63fa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:11.423488 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c06c2636-44a2-48f2-bb7f-2d02300f63fa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:11.424260 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c06c2636-44a2-48f2-bb7f-2d02300f63fa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:11.424983 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c06c2636-44a2-48f2-bb7f-2d02300f63fa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:11.425554 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c06c2636-44a2-48f2-bb7f-2d02300f63fa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:11.517274 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-6e283e80-8f7e-43a8-86a7-31e591c90f8c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:11.518681 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-6e283e80-8f7e-43a8-86a7-31e591c90f8c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:11.530552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6e283e80-8f7e-43a8-86a7-31e591c90f8c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:11.531464 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6e283e80-8f7e-43a8-86a7-31e591c90f8c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:11.532439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6e283e80-8f7e-43a8-86a7-31e591c90f8c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:11.542980 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6e283e80-8f7e-43a8-86a7-31e591c90f8c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:11.543506 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6e283e80-8f7e-43a8-86a7-31e591c90f8c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:11.546806 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6e283e80-8f7e-43a8-86a7-31e591c90f8c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:11.704918 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c06c2636-44a2-48f2-bb7f-2d02300f63fa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:11.714287 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c06c2636-44a2-48f2-bb7f-2d02300f63fa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.342354 Sep 15 12:59:11.720409 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 41/95] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:11 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:11.725223 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-bfd4891a-c96a-42e0-984e-6874cdbb1b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:11.729156 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-bfd4891a-c96a-42e0-984e-6874cdbb1b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:11.740411 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bfd4891a-c96a-42e0-984e-6874cdbb1b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:11.741918 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bfd4891a-c96a-42e0-984e-6874cdbb1b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:11.742693 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bfd4891a-c96a-42e0-984e-6874cdbb1b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:11.745773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bfd4891a-c96a-42e0-984e-6874cdbb1b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:11.749071 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bfd4891a-c96a-42e0-984e-6874cdbb1b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:11.749673 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bfd4891a-c96a-42e0-984e-6874cdbb1b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:11.980344 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-bfd4891a-c96a-42e0-984e-6874cdbb1b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:11.997815 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-bfd4891a-c96a-42e0-984e-6874cdbb1b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.274915 Sep 15 12:59:12.000425 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 42/96] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:11 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:12.133247 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-140b6c11-2da3-4e76-889f-9cff91b2b003 req-56fee6a8-c4bb-452d-981b-3bd94d186aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1777381a-01af-43ba-98dc-31bfeeded7bb", "tag": "12b0a8a8-4a84-4e3e-8e96-e6939fe11e18"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:12.154379 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-140b6c11-2da3-4e76-889f-9cff91b2b003 req-56fee6a8-c4bb-452d-981b-3bd94d186aa1 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:12.154855 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-140b6c11-2da3-4e76-889f-9cff91b2b003 req-56fee6a8-c4bb-452d-981b-3bd94d186aa1 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:12.155456 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-140b6c11-2da3-4e76-889f-9cff91b2b003 req-56fee6a8-c4bb-452d-981b-3bd94d186aa1 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:12.179972 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-140b6c11-2da3-4e76-889f-9cff91b2b003 req-56fee6a8-c4bb-452d-981b-3bd94d186aa1 service nova] Creating event network-changed:12b0a8a8-4a84-4e3e-8e96-e6939fe11e18 for instance 1777381a-01af-43ba-98dc-31bfeeded7bb on hv-cinder-83608 Sep 15 12:59:12.185232 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-140b6c11-2da3-4e76-889f-9cff91b2b003 req-56fee6a8-c4bb-452d-981b-3bd94d186aa1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055749 Sep 15 12:59:12.186058 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 43/97] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:59:12.186239 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-6e283e80-8f7e-43a8-86a7-31e591c90f8c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:12.198558 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-6e283e80-8f7e-43a8-86a7-31e591c90f8c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.686272 Sep 15 12:59:12.199525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 55/98] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:11 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:12.394072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-128765b1-9577-4e06-8d44-10c866f801d3 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:12.394884 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-128765b1-9577-4e06-8d44-10c866f801d3 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:12.404364 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-128765b1-9577-4e06-8d44-10c866f801d3 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:12.405091 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-128765b1-9577-4e06-8d44-10c866f801d3 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:12.405684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-128765b1-9577-4e06-8d44-10c866f801d3 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:12.406522 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-128765b1-9577-4e06-8d44-10c866f801d3 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:12.407121 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-128765b1-9577-4e06-8d44-10c866f801d3 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:12.407698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-128765b1-9577-4e06-8d44-10c866f801d3 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:12.438361 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7771babd-fb89-492a-a3f6-dde8b9d725db tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:12.439121 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7771babd-fb89-492a-a3f6-dde8b9d725db tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:12.448886 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7771babd-fb89-492a-a3f6-dde8b9d725db tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:12.449600 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7771babd-fb89-492a-a3f6-dde8b9d725db tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:12.450305 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7771babd-fb89-492a-a3f6-dde8b9d725db tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:12.451244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7771babd-fb89-492a-a3f6-dde8b9d725db tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:12.451882 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7771babd-fb89-492a-a3f6-dde8b9d725db tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:12.453119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7771babd-fb89-492a-a3f6-dde8b9d725db tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:12.572479 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-128765b1-9577-4e06-8d44-10c866f801d3 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:12.583418 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-128765b1-9577-4e06-8d44-10c866f801d3 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 0.193528 Sep 15 12:59:12.584131 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 44/99] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:12 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:12.603847 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-f40f75a4-9b7a-45d0-bcb1-9967b412a93a req-f67fac71-c34a-4dab-b1c1-7d491914e3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19c1c10-a0cf-4be2-907e-d210ec6cddbb", "tag": "f63af2cc-ef44-4098-a900-c09daa2c63e4"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:12.623885 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-f40f75a4-9b7a-45d0-bcb1-9967b412a93a req-f67fac71-c34a-4dab-b1c1-7d491914e3b0 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:12.624453 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-f40f75a4-9b7a-45d0-bcb1-9967b412a93a req-f67fac71-c34a-4dab-b1c1-7d491914e3b0 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:12.625382 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-f40f75a4-9b7a-45d0-bcb1-9967b412a93a req-f67fac71-c34a-4dab-b1c1-7d491914e3b0 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:12.638634 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-f40f75a4-9b7a-45d0-bcb1-9967b412a93a req-f67fac71-c34a-4dab-b1c1-7d491914e3b0 service nova] Creating event network-changed:f63af2cc-ef44-4098-a900-c09daa2c63e4 for instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb on hv-cinder-83608 Sep 15 12:59:12.644013 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-f40f75a4-9b7a-45d0-bcb1-9967b412a93a req-f67fac71-c34a-4dab-b1c1-7d491914e3b0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057341 Sep 15 12:59:12.644952 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 45/100] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:59:12.731586 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7771babd-fb89-492a-a3f6-dde8b9d725db tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:12.742688 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1d1a5ce0-5883-45e9-a577-b1caf3161fc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:12.744509 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1d1a5ce0-5883-45e9-a577-b1caf3161fc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:12.746745 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7771babd-fb89-492a-a3f6-dde8b9d725db tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:12.749541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7771babd-fb89-492a-a3f6-dde8b9d725db tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:12.751115 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7771babd-fb89-492a-a3f6-dde8b9d725db tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.316832 Sep 15 12:59:12.752208 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 56/101] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:12 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:59:12.755780 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d1a5ce0-5883-45e9-a577-b1caf3161fc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:12.756316 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d1a5ce0-5883-45e9-a577-b1caf3161fc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:12.756981 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d1a5ce0-5883-45e9-a577-b1caf3161fc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:12.757769 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d1a5ce0-5883-45e9-a577-b1caf3161fc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:12.758252 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d1a5ce0-5883-45e9-a577-b1caf3161fc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:12.758786 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d1a5ce0-5883-45e9-a577-b1caf3161fc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:12.918905 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1d1a5ce0-5883-45e9-a577-b1caf3161fc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:12.927489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1d1a5ce0-5883-45e9-a577-b1caf3161fc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.191918 Sep 15 12:59:12.943570 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 46/102] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:12 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:13.025622 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0d6e0296-eebf-4b4e-8a95-0f4a18572502 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:13.026358 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0d6e0296-eebf-4b4e-8a95-0f4a18572502 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:13.036295 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0d6e0296-eebf-4b4e-8a95-0f4a18572502 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:13.037636 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0d6e0296-eebf-4b4e-8a95-0f4a18572502 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:13.038139 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0d6e0296-eebf-4b4e-8a95-0f4a18572502 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:13.039038 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0d6e0296-eebf-4b4e-8a95-0f4a18572502 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:13.039698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0d6e0296-eebf-4b4e-8a95-0f4a18572502 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:13.040171 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0d6e0296-eebf-4b4e-8a95-0f4a18572502 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:13.045204 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=100 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:13.222706 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fe8435a2-a005-404c-be28-c5ad93c4e324 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:13.223329 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-fe8435a2-a005-404c-be28-c5ad93c4e324 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:13.234424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe8435a2-a005-404c-be28-c5ad93c4e324 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:13.235650 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe8435a2-a005-404c-be28-c5ad93c4e324 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:13.236112 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe8435a2-a005-404c-be28-c5ad93c4e324 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:13.236848 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe8435a2-a005-404c-be28-c5ad93c4e324 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:13.237304 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe8435a2-a005-404c-be28-c5ad93c4e324 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:13.237728 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe8435a2-a005-404c-be28-c5ad93c4e324 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:13.300396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0d6e0296-eebf-4b4e-8a95-0f4a18572502 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:13.312504 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0d6e0296-eebf-4b4e-8a95-0f4a18572502 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.293435 Sep 15 12:59:13.313684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 57/103] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:13 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:13.482330 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-fe8435a2-a005-404c-be28-c5ad93c4e324 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:13.491889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-fe8435a2-a005-404c-be28-c5ad93c4e324 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.273863 Sep 15 12:59:13.493768 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 47/104] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:13 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:13.607383 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c75ce332-1d23-4096-b7a3-334a07076139 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:13.607992 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c75ce332-1d23-4096-b7a3-334a07076139 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:13.614931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c75ce332-1d23-4096-b7a3-334a07076139 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:13.615473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c75ce332-1d23-4096-b7a3-334a07076139 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:13.615838 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c75ce332-1d23-4096-b7a3-334a07076139 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:13.616653 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c75ce332-1d23-4096-b7a3-334a07076139 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:13.617103 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c75ce332-1d23-4096-b7a3-334a07076139 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:13.617517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c75ce332-1d23-4096-b7a3-334a07076139 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:13.777922 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1e108b11-342f-4e44-baf4-274439e08238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:13.779164 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1e108b11-342f-4e44-baf4-274439e08238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:13.789089 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e108b11-342f-4e44-baf4-274439e08238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:13.789583 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e108b11-342f-4e44-baf4-274439e08238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:13.792637 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e108b11-342f-4e44-baf4-274439e08238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:13.793693 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e108b11-342f-4e44-baf4-274439e08238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:13.794571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e108b11-342f-4e44-baf4-274439e08238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:13.797151 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e108b11-342f-4e44-baf4-274439e08238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:13.977955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1e108b11-342f-4e44-baf4-274439e08238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:13.987506 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1e108b11-342f-4e44-baf4-274439e08238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:13.989048 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1e108b11-342f-4e44-baf4-274439e08238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:13.990388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1e108b11-342f-4e44-baf4-274439e08238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.216936 Sep 15 12:59:13.991138 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 48/105] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:13 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:13.996964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-dc83c573-db72-451e-8bae-3465f0df1f09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:13.997800 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-dc83c573-db72-451e-8bae-3465f0df1f09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:14.003949 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dc83c573-db72-451e-8bae-3465f0df1f09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:14.004698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dc83c573-db72-451e-8bae-3465f0df1f09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:14.005195 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dc83c573-db72-451e-8bae-3465f0df1f09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:14.006087 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dc83c573-db72-451e-8bae-3465f0df1f09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:14.006627 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dc83c573-db72-451e-8bae-3465f0df1f09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:14.007117 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dc83c573-db72-451e-8bae-3465f0df1f09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:14.017001 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c75ce332-1d23-4096-b7a3-334a07076139 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:14.025738 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c75ce332-1d23-4096-b7a3-334a07076139 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 0.422522 Sep 15 12:59:14.032600 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 58/106] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:13 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:14.277217 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-dc83c573-db72-451e-8bae-3465f0df1f09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:14.285097 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-dc83c573-db72-451e-8bae-3465f0df1f09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.292754 Sep 15 12:59:14.285666 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 49/107] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:13 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:14.340448 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0688dee0-5ee3-4f4b-84b7-d4b76e9e24f4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:14.341841 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0688dee0-5ee3-4f4b-84b7-d4b76e9e24f4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:14.349478 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0688dee0-5ee3-4f4b-84b7-d4b76e9e24f4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:14.349963 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0688dee0-5ee3-4f4b-84b7-d4b76e9e24f4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:14.350387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0688dee0-5ee3-4f4b-84b7-d4b76e9e24f4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:14.351085 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0688dee0-5ee3-4f4b-84b7-d4b76e9e24f4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:14.352054 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0688dee0-5ee3-4f4b-84b7-d4b76e9e24f4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:14.353048 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0688dee0-5ee3-4f4b-84b7-d4b76e9e24f4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:14.518183 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b526fd8d-7031-459a-9789-8dccc369ed78 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:14.519325 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b526fd8d-7031-459a-9789-8dccc369ed78 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:14.521743 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0688dee0-5ee3-4f4b-84b7-d4b76e9e24f4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:14.531703 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b526fd8d-7031-459a-9789-8dccc369ed78 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:14.533016 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b526fd8d-7031-459a-9789-8dccc369ed78 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:14.533635 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b526fd8d-7031-459a-9789-8dccc369ed78 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:14.534862 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b526fd8d-7031-459a-9789-8dccc369ed78 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:14.535495 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b526fd8d-7031-459a-9789-8dccc369ed78 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:14.535879 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0688dee0-5ee3-4f4b-84b7-d4b76e9e24f4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.200856 Sep 15 12:59:14.536393 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b526fd8d-7031-459a-9789-8dccc369ed78 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:14.551149 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 59/108] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:14 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:14.609984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=8 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:14.923177 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b526fd8d-7031-459a-9789-8dccc369ed78 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:14.934437 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b526fd8d-7031-459a-9789-8dccc369ed78 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.422261 Sep 15 12:59:14.935034 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 50/109] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:14 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:15.025593 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-46aa1b3b-792e-4dfb-b27d-ba3a76743c2c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:15.026214 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-46aa1b3b-792e-4dfb-b27d-ba3a76743c2c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:15.038048 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46aa1b3b-792e-4dfb-b27d-ba3a76743c2c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:15.041189 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46aa1b3b-792e-4dfb-b27d-ba3a76743c2c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:15.042645 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46aa1b3b-792e-4dfb-b27d-ba3a76743c2c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:15.044306 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46aa1b3b-792e-4dfb-b27d-ba3a76743c2c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:15.045008 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46aa1b3b-792e-4dfb-b27d-ba3a76743c2c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:15.045606 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46aa1b3b-792e-4dfb-b27d-ba3a76743c2c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:15.050981 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d0b95604-c1d1-4e72-a527-32475836c608 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:15.051599 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d0b95604-c1d1-4e72-a527-32475836c608 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:15.063488 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d0b95604-c1d1-4e72-a527-32475836c608 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:15.064580 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d0b95604-c1d1-4e72-a527-32475836c608 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:15.065905 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d0b95604-c1d1-4e72-a527-32475836c608 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:15.067837 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d0b95604-c1d1-4e72-a527-32475836c608 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:15.068336 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d0b95604-c1d1-4e72-a527-32475836c608 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:15.069930 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d0b95604-c1d1-4e72-a527-32475836c608 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:15.363614 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-46aa1b3b-792e-4dfb-b27d-ba3a76743c2c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:15.376295 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-46aa1b3b-792e-4dfb-b27d-ba3a76743c2c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:15.377794 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-46aa1b3b-792e-4dfb-b27d-ba3a76743c2c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:15.378921 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-46aa1b3b-792e-4dfb-b27d-ba3a76743c2c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.358488 Sep 15 12:59:15.379640 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 60/110] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:15 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:15.388694 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ae548e09-1d8e-4008-8029-af19eb7dc83f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:15.388694 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ae548e09-1d8e-4008-8029-af19eb7dc83f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:15.392203 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ae548e09-1d8e-4008-8029-af19eb7dc83f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:15.392725 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ae548e09-1d8e-4008-8029-af19eb7dc83f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:15.393156 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ae548e09-1d8e-4008-8029-af19eb7dc83f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:15.394019 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ae548e09-1d8e-4008-8029-af19eb7dc83f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:15.394515 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ae548e09-1d8e-4008-8029-af19eb7dc83f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:15.394896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ae548e09-1d8e-4008-8029-af19eb7dc83f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:15.957092 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ae548e09-1d8e-4008-8029-af19eb7dc83f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:15.969685 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ae548e09-1d8e-4008-8029-af19eb7dc83f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.588866 Sep 15 12:59:15.970210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 61/111] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:15 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:15.992654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-1fd53113-021f-4ae7-8597-eb1757b7f0a7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:15.995454 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-1fd53113-021f-4ae7-8597-eb1757b7f0a7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:16.003170 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1fd53113-021f-4ae7-8597-eb1757b7f0a7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:16.004046 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1fd53113-021f-4ae7-8597-eb1757b7f0a7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:16.005146 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1fd53113-021f-4ae7-8597-eb1757b7f0a7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:16.006158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1fd53113-021f-4ae7-8597-eb1757b7f0a7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:16.006826 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1fd53113-021f-4ae7-8597-eb1757b7f0a7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:16.007577 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1fd53113-021f-4ae7-8597-eb1757b7f0a7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:16.123962 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d0b95604-c1d1-4e72-a527-32475836c608 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:16.126626 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=100 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:16.136475 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d0b95604-c1d1-4e72-a527-32475836c608 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 1.090122 Sep 15 12:59:16.151562 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 51/112] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:15 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:16.151562 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d47952fa-a5ac-4696-8749-3004d16c9c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:16.151562 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d47952fa-a5ac-4696-8749-3004d16c9c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:16.157428 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d47952fa-a5ac-4696-8749-3004d16c9c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:16.159516 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d47952fa-a5ac-4696-8749-3004d16c9c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:16.159798 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d47952fa-a5ac-4696-8749-3004d16c9c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:16.160562 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d47952fa-a5ac-4696-8749-3004d16c9c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:16.161020 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d47952fa-a5ac-4696-8749-3004d16c9c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:16.163450 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d47952fa-a5ac-4696-8749-3004d16c9c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:16.387794 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-1fd53113-021f-4ae7-8597-eb1757b7f0a7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:16.399056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-1fd53113-021f-4ae7-8597-eb1757b7f0a7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.424932 Sep 15 12:59:16.400173 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 62/113] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:15 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:16.406832 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4f28ad79-0347-495e-a5bb-d8c9cc54d8d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:16.412085 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-4f28ad79-0347-495e-a5bb-d8c9cc54d8d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:16.424650 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f28ad79-0347-495e-a5bb-d8c9cc54d8d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:16.425318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f28ad79-0347-495e-a5bb-d8c9cc54d8d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:16.426290 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f28ad79-0347-495e-a5bb-d8c9cc54d8d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:16.427463 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f28ad79-0347-495e-a5bb-d8c9cc54d8d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:16.429955 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f28ad79-0347-495e-a5bb-d8c9cc54d8d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:16.431884 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f28ad79-0347-495e-a5bb-d8c9cc54d8d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:16.627765 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d47952fa-a5ac-4696-8749-3004d16c9c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:16.637810 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d47952fa-a5ac-4696-8749-3004d16c9c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.498810 Sep 15 12:59:16.644488 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 52/114] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:16 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:16.733683 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4f28ad79-0347-495e-a5bb-d8c9cc54d8d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:16.743643 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4f28ad79-0347-495e-a5bb-d8c9cc54d8d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:16.746394 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4f28ad79-0347-495e-a5bb-d8c9cc54d8d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:16.747646 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-4f28ad79-0347-495e-a5bb-d8c9cc54d8d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.344662 Sep 15 12:59:16.748341 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 63/115] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:16 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:16.997152 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5d666a23-970f-4266-82ea-8a6ce2a592cf tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:16.998412 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5d666a23-970f-4266-82ea-8a6ce2a592cf tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:17.009313 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5d666a23-970f-4266-82ea-8a6ce2a592cf tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:17.010488 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5d666a23-970f-4266-82ea-8a6ce2a592cf tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:17.011344 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5d666a23-970f-4266-82ea-8a6ce2a592cf tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:17.012639 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5d666a23-970f-4266-82ea-8a6ce2a592cf tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:17.013436 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5d666a23-970f-4266-82ea-8a6ce2a592cf tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:17.014069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5d666a23-970f-4266-82ea-8a6ce2a592cf tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:17.162974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ca2fc305-8e8e-494a-ae15-13df4855b110 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:17.163746 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ca2fc305-8e8e-494a-ae15-13df4855b110 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:17.177034 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ca2fc305-8e8e-494a-ae15-13df4855b110 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:17.177517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ca2fc305-8e8e-494a-ae15-13df4855b110 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:17.177945 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ca2fc305-8e8e-494a-ae15-13df4855b110 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:17.178648 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ca2fc305-8e8e-494a-ae15-13df4855b110 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:17.179100 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ca2fc305-8e8e-494a-ae15-13df4855b110 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:17.179514 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ca2fc305-8e8e-494a-ae15-13df4855b110 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:17.289609 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5d666a23-970f-4266-82ea-8a6ce2a592cf tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:17.302603 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5d666a23-970f-4266-82ea-8a6ce2a592cf tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.310025 Sep 15 12:59:17.319071 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 53/116] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:16 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:17.426063 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4a7da3f1-09c2-4e72-9707-bcf9b1fb9ec8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:17.427393 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-4a7da3f1-09c2-4e72-9707-bcf9b1fb9ec8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:17.439337 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a7da3f1-09c2-4e72-9707-bcf9b1fb9ec8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:17.442661 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a7da3f1-09c2-4e72-9707-bcf9b1fb9ec8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:17.443563 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a7da3f1-09c2-4e72-9707-bcf9b1fb9ec8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:17.444577 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a7da3f1-09c2-4e72-9707-bcf9b1fb9ec8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:17.445237 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a7da3f1-09c2-4e72-9707-bcf9b1fb9ec8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:17.446839 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a7da3f1-09c2-4e72-9707-bcf9b1fb9ec8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:17.496176 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ca2fc305-8e8e-494a-ae15-13df4855b110 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:17.512570 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ca2fc305-8e8e-494a-ae15-13df4855b110 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 0.352999 Sep 15 12:59:17.513261 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 64/117] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:17 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:17.661578 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-6a4392d9-2430-42d8-a906-2ce9744d5bbf tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:17.662531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-6a4392d9-2430-42d8-a906-2ce9744d5bbf tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:17.668082 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-4a7da3f1-09c2-4e72-9707-bcf9b1fb9ec8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:17.673367 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6a4392d9-2430-42d8-a906-2ce9744d5bbf tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:17.674507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6a4392d9-2430-42d8-a906-2ce9744d5bbf tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:17.675789 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6a4392d9-2430-42d8-a906-2ce9744d5bbf tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:17.676767 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6a4392d9-2430-42d8-a906-2ce9744d5bbf tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:17.677826 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-4a7da3f1-09c2-4e72-9707-bcf9b1fb9ec8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.258602 Sep 15 12:59:17.678069 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6a4392d9-2430-42d8-a906-2ce9744d5bbf tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:17.678726 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6a4392d9-2430-42d8-a906-2ce9744d5bbf tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:17.678848 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 54/118] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:17 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:17.776681 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-030e3218-d38c-4e13-b72f-4a07b5b16b8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:17.777428 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-030e3218-d38c-4e13-b72f-4a07b5b16b8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:17.789391 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-030e3218-d38c-4e13-b72f-4a07b5b16b8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:17.791210 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-030e3218-d38c-4e13-b72f-4a07b5b16b8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:17.791663 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-030e3218-d38c-4e13-b72f-4a07b5b16b8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:17.795738 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-030e3218-d38c-4e13-b72f-4a07b5b16b8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:17.796259 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-030e3218-d38c-4e13-b72f-4a07b5b16b8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:17.799363 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-030e3218-d38c-4e13-b72f-4a07b5b16b8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:17.894877 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-6a4392d9-2430-42d8-a906-2ce9744d5bbf tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:17.904044 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-6a4392d9-2430-42d8-a906-2ce9744d5bbf tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.246915 Sep 15 12:59:17.904904 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 65/119] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:17 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:18.033457 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-030e3218-d38c-4e13-b72f-4a07b5b16b8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:18.042830 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-030e3218-d38c-4e13-b72f-4a07b5b16b8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:18.044301 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-030e3218-d38c-4e13-b72f-4a07b5b16b8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:18.045947 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-030e3218-d38c-4e13-b72f-4a07b5b16b8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.274668 Sep 15 12:59:18.046829 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 55/120] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:17 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:59:18.213086 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-e4cddf69-a6f1-4949-8c27-3b3b3e8796dd req-c6cbcd75-e762-47c7-bd6e-42a3e696b916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd7739a-69fe-4204-be18-f21e623d0992", "name": "network-vif-plugged", "status": "completed", "tag": "e1b7b694-7f38-474e-8781-153677c9fb5b"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:18.226963 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e4cddf69-a6f1-4949-8c27-3b3b3e8796dd req-c6cbcd75-e762-47c7-bd6e-42a3e696b916 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:18.227670 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e4cddf69-a6f1-4949-8c27-3b3b3e8796dd req-c6cbcd75-e762-47c7-bd6e-42a3e696b916 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:18.228533 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e4cddf69-a6f1-4949-8c27-3b3b3e8796dd req-c6cbcd75-e762-47c7-bd6e-42a3e696b916 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:18.248374 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-e4cddf69-a6f1-4949-8c27-3b3b3e8796dd req-c6cbcd75-e762-47c7-bd6e-42a3e696b916 service nova] Creating event network-vif-plugged:e1b7b694-7f38-474e-8781-153677c9fb5b for instance 9fd7739a-69fe-4204-be18-f21e623d0992 on hv-cinder-83608 Sep 15 12:59:18.248894 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e4cddf69-a6f1-4949-8c27-3b3b3e8796dd req-c6cbcd75-e762-47c7-bd6e-42a3e696b916 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 15 12:59:18.249451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e4cddf69-a6f1-4949-8c27-3b3b3e8796dd req-c6cbcd75-e762-47c7-bd6e-42a3e696b916 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 15 12:59:18.250497 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28776bc1-5965-4882-be5b-9f967e748500 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:18.251077 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28776bc1-5965-4882-be5b-9f967e748500 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:18.251507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28776bc1-5965-4882-be5b-9f967e748500 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:18.252219 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28776bc1-5965-4882-be5b-9f967e748500 None None] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:18.252676 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28776bc1-5965-4882-be5b-9f967e748500 None None] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:18.253089 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28776bc1-5965-4882-be5b-9f967e748500 None None] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:18.262842 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.compute.rpcapi [None req-28776bc1-5965-4882-be5b-9f967e748500 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 15 12:59:18.263722 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28776bc1-5965-4882-be5b-9f967e748500 None None] Releasing lock "compute-rpcapi-router" {{(pid=120633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 15 12:59:18.283396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-28776bc1-5965-4882-be5b-9f967e748500 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281213 Sep 15 12:59:18.284765 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 66/121] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:59:18.326844 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f3079185-a82d-413c-b9d7-71a1d7db20f6 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:18.327456 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f3079185-a82d-413c-b9d7-71a1d7db20f6 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:18.334580 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f3079185-a82d-413c-b9d7-71a1d7db20f6 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:18.334855 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f3079185-a82d-413c-b9d7-71a1d7db20f6 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:18.335490 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f3079185-a82d-413c-b9d7-71a1d7db20f6 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:18.336190 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f3079185-a82d-413c-b9d7-71a1d7db20f6 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:18.336749 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f3079185-a82d-413c-b9d7-71a1d7db20f6 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:18.337308 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f3079185-a82d-413c-b9d7-71a1d7db20f6 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:18.477997 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f3079185-a82d-413c-b9d7-71a1d7db20f6 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:18.486914 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f3079185-a82d-413c-b9d7-71a1d7db20f6 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.165372 Sep 15 12:59:18.500595 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 56/122] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:18 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:18.538050 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-48ac92d8-471f-4460-8136-ac3f925724d0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:18.538977 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-48ac92d8-471f-4460-8136-ac3f925724d0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:18.545264 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-48ac92d8-471f-4460-8136-ac3f925724d0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:18.545754 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-48ac92d8-471f-4460-8136-ac3f925724d0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:18.546189 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-48ac92d8-471f-4460-8136-ac3f925724d0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:18.547035 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-48ac92d8-471f-4460-8136-ac3f925724d0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:18.547673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-48ac92d8-471f-4460-8136-ac3f925724d0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:18.548104 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-48ac92d8-471f-4460-8136-ac3f925724d0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:18.703328 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1d03dc17-7b8a-4bfb-98d6-a9ea0b913fc3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:18.703945 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1d03dc17-7b8a-4bfb-98d6-a9ea0b913fc3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:18.710807 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d03dc17-7b8a-4bfb-98d6-a9ea0b913fc3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:18.715113 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d03dc17-7b8a-4bfb-98d6-a9ea0b913fc3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:18.715572 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d03dc17-7b8a-4bfb-98d6-a9ea0b913fc3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:18.723487 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d03dc17-7b8a-4bfb-98d6-a9ea0b913fc3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:18.723907 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d03dc17-7b8a-4bfb-98d6-a9ea0b913fc3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:18.724380 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d03dc17-7b8a-4bfb-98d6-a9ea0b913fc3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:18.810624 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-48ac92d8-471f-4460-8136-ac3f925724d0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:18.824533 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-48ac92d8-471f-4460-8136-ac3f925724d0 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 0.292114 Sep 15 12:59:18.844696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 67/123] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:18 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:18.929896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-372738bf-c090-416d-9a78-00367a6a07d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:18.930673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-372738bf-c090-416d-9a78-00367a6a07d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:18.942343 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-372738bf-c090-416d-9a78-00367a6a07d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:18.943191 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-372738bf-c090-416d-9a78-00367a6a07d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:18.943633 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-372738bf-c090-416d-9a78-00367a6a07d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:18.944404 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-372738bf-c090-416d-9a78-00367a6a07d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:18.944807 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-372738bf-c090-416d-9a78-00367a6a07d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:18.945237 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-372738bf-c090-416d-9a78-00367a6a07d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:19.333737 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1d03dc17-7b8a-4bfb-98d6-a9ea0b913fc3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:19.345271 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1d03dc17-7b8a-4bfb-98d6-a9ea0b913fc3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.645631 Sep 15 12:59:19.360334 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 57/124] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:18 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:19.366239 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1b082e27-3607-4970-a7e0-198a7c55fd1c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:19.366995 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1b082e27-3607-4970-a7e0-198a7c55fd1c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:19.375703 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1b082e27-3607-4970-a7e0-198a7c55fd1c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:19.376197 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1b082e27-3607-4970-a7e0-198a7c55fd1c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:19.376729 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1b082e27-3607-4970-a7e0-198a7c55fd1c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:19.377437 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1b082e27-3607-4970-a7e0-198a7c55fd1c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:19.377890 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1b082e27-3607-4970-a7e0-198a7c55fd1c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:19.378313 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1b082e27-3607-4970-a7e0-198a7c55fd1c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:19.474653 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-372738bf-c090-416d-9a78-00367a6a07d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:19.490838 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-372738bf-c090-416d-9a78-00367a6a07d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.567719 Sep 15 12:59:19.492262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 68/125] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:18 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:19.518661 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f11e3d9c-4583-4dde-958f-1a12d5f5c649 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:19.526883 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f11e3d9c-4583-4dde-958f-1a12d5f5c649 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:19.535377 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f11e3d9c-4583-4dde-958f-1a12d5f5c649 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:19.536391 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f11e3d9c-4583-4dde-958f-1a12d5f5c649 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:19.536987 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f11e3d9c-4583-4dde-958f-1a12d5f5c649 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:19.538411 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f11e3d9c-4583-4dde-958f-1a12d5f5c649 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:19.540143 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f11e3d9c-4583-4dde-958f-1a12d5f5c649 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:19.540802 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f11e3d9c-4583-4dde-958f-1a12d5f5c649 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:19.562752 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1b082e27-3607-4970-a7e0-198a7c55fd1c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:19.577073 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1b082e27-3607-4970-a7e0-198a7c55fd1c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:19.579029 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1b082e27-3607-4970-a7e0-198a7c55fd1c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:19.581339 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1b082e27-3607-4970-a7e0-198a7c55fd1c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.233403 Sep 15 12:59:19.582342 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 58/126] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:19 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:19.731168 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f11e3d9c-4583-4dde-958f-1a12d5f5c649 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:19.740618 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f11e3d9c-4583-4dde-958f-1a12d5f5c649 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.231408 Sep 15 12:59:19.752291 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 69/127] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:19 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:19.851688 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-7237ec59-ebed-40b2-ab70-83947f77c96c tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:19.853642 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-7237ec59-ebed-40b2-ab70-83947f77c96c tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:19.860970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7237ec59-ebed-40b2-ab70-83947f77c96c tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:19.861458 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7237ec59-ebed-40b2-ab70-83947f77c96c tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:19.861893 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7237ec59-ebed-40b2-ab70-83947f77c96c tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:19.863073 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7237ec59-ebed-40b2-ab70-83947f77c96c tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:19.864032 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7237ec59-ebed-40b2-ab70-83947f77c96c tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:19.864765 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7237ec59-ebed-40b2-ab70-83947f77c96c tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:20.004334 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-7237ec59-ebed-40b2-ab70-83947f77c96c tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:20.017016 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-7237ec59-ebed-40b2-ab70-83947f77c96c tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 0.166690 Sep 15 12:59:20.017016 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 59/128] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:19 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:20.303152 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-c3f2f388-4bfb-4d22-912f-b81c79f5c3b8 req-f40a79e2-4c95-440c-9e91-421bc550bd19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a48c801-810d-4702-a905-a6109e4786d8", "name": "network-vif-plugged", "status": "completed", "tag": "15fae3ac-3d15-4151-bd85-4686ea0f64b1"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:20.310988 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-c3f2f388-4bfb-4d22-912f-b81c79f5c3b8 req-f40a79e2-4c95-440c-9e91-421bc550bd19 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:20.311471 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-c3f2f388-4bfb-4d22-912f-b81c79f5c3b8 req-f40a79e2-4c95-440c-9e91-421bc550bd19 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:20.311901 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-c3f2f388-4bfb-4d22-912f-b81c79f5c3b8 req-f40a79e2-4c95-440c-9e91-421bc550bd19 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:20.323391 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-c3f2f388-4bfb-4d22-912f-b81c79f5c3b8 req-f40a79e2-4c95-440c-9e91-421bc550bd19 service nova] Creating event network-vif-plugged:15fae3ac-3d15-4151-bd85-4686ea0f64b1 for instance 7a48c801-810d-4702-a905-a6109e4786d8 on hv-cinder-83608 Sep 15 12:59:20.328650 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-c3f2f388-4bfb-4d22-912f-b81c79f5c3b8 req-f40a79e2-4c95-440c-9e91-421bc550bd19 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030972 Sep 15 12:59:20.329755 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 70/129] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:59:20.371369 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-677c0fbe-bb1e-43a8-940e-b95163c53f2f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:20.372041 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-677c0fbe-bb1e-43a8-940e-b95163c53f2f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:20.378340 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-677c0fbe-bb1e-43a8-940e-b95163c53f2f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:20.378891 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-677c0fbe-bb1e-43a8-940e-b95163c53f2f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:20.379406 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-677c0fbe-bb1e-43a8-940e-b95163c53f2f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:20.380165 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-677c0fbe-bb1e-43a8-940e-b95163c53f2f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:20.380699 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-677c0fbe-bb1e-43a8-940e-b95163c53f2f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:20.381183 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-677c0fbe-bb1e-43a8-940e-b95163c53f2f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:20.514100 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cd8cc02f-d9a8-4ad9-ab80-c40b3c59de37 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:20.515038 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cd8cc02f-d9a8-4ad9-ab80-c40b3c59de37 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:20.525456 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd8cc02f-d9a8-4ad9-ab80-c40b3c59de37 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:20.526661 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd8cc02f-d9a8-4ad9-ab80-c40b3c59de37 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:20.528207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd8cc02f-d9a8-4ad9-ab80-c40b3c59de37 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:20.529210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd8cc02f-d9a8-4ad9-ab80-c40b3c59de37 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:20.529872 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd8cc02f-d9a8-4ad9-ab80-c40b3c59de37 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:20.530489 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd8cc02f-d9a8-4ad9-ab80-c40b3c59de37 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:20.546569 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-677c0fbe-bb1e-43a8-940e-b95163c53f2f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:20.555225 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-677c0fbe-bb1e-43a8-940e-b95163c53f2f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.187994 Sep 15 12:59:20.556131 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 60/130] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:20 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:20.608134 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c6295228-4a68-420b-9b00-df6eb40df05d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:20.608775 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c6295228-4a68-420b-9b00-df6eb40df05d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:20.618979 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c6295228-4a68-420b-9b00-df6eb40df05d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:20.619430 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c6295228-4a68-420b-9b00-df6eb40df05d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:20.619876 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c6295228-4a68-420b-9b00-df6eb40df05d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:20.620601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c6295228-4a68-420b-9b00-df6eb40df05d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:20.622646 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c6295228-4a68-420b-9b00-df6eb40df05d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:20.623096 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c6295228-4a68-420b-9b00-df6eb40df05d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:20.708610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cd8cc02f-d9a8-4ad9-ab80-c40b3c59de37 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:20.718056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cd8cc02f-d9a8-4ad9-ab80-c40b3c59de37 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.208430 Sep 15 12:59:20.718829 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 71/131] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:20 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:20.765271 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-1048ab81-3531-4bde-9d85-20ff554a7328 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:20.765887 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-1048ab81-3531-4bde-9d85-20ff554a7328 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:20.772974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1048ab81-3531-4bde-9d85-20ff554a7328 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:20.773467 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1048ab81-3531-4bde-9d85-20ff554a7328 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:20.773896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1048ab81-3531-4bde-9d85-20ff554a7328 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:20.775160 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1048ab81-3531-4bde-9d85-20ff554a7328 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:20.776080 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1048ab81-3531-4bde-9d85-20ff554a7328 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:20.776548 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1048ab81-3531-4bde-9d85-20ff554a7328 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:20.809588 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c6295228-4a68-420b-9b00-df6eb40df05d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:20.818417 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c6295228-4a68-420b-9b00-df6eb40df05d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:20.819889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c6295228-4a68-420b-9b00-df6eb40df05d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:20.821131 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c6295228-4a68-420b-9b00-df6eb40df05d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.216682 Sep 15 12:59:20.823198 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 61/132] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:20 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:59:20.982041 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-1048ab81-3531-4bde-9d85-20ff554a7328 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:21.004823 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-1048ab81-3531-4bde-9d85-20ff554a7328 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.244390 Sep 15 12:59:21.007839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 72/133] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:20 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:21.037899 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-960d1287-d48c-4f36-8683-eb2b293e4227 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:21.040675 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-960d1287-d48c-4f36-8683-eb2b293e4227 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:21.050128 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-960d1287-d48c-4f36-8683-eb2b293e4227 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:21.050900 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-960d1287-d48c-4f36-8683-eb2b293e4227 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:21.051264 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-960d1287-d48c-4f36-8683-eb2b293e4227 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:21.053618 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-960d1287-d48c-4f36-8683-eb2b293e4227 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:21.054163 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-960d1287-d48c-4f36-8683-eb2b293e4227 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:21.054599 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-960d1287-d48c-4f36-8683-eb2b293e4227 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:21.248337 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-960d1287-d48c-4f36-8683-eb2b293e4227 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:21.255935 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-960d1287-d48c-4f36-8683-eb2b293e4227 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 0.222878 Sep 15 12:59:21.258475 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 62/134] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:21 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:21.581296 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-55507bac-7b4c-4b33-9a3d-40c495f71353 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:21.581921 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-55507bac-7b4c-4b33-9a3d-40c495f71353 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:21.589513 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55507bac-7b4c-4b33-9a3d-40c495f71353 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:21.590351 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55507bac-7b4c-4b33-9a3d-40c495f71353 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:21.591202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55507bac-7b4c-4b33-9a3d-40c495f71353 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:21.591910 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55507bac-7b4c-4b33-9a3d-40c495f71353 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:21.592384 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55507bac-7b4c-4b33-9a3d-40c495f71353 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:21.592969 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55507bac-7b4c-4b33-9a3d-40c495f71353 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:21.741745 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b368a732-37d3-4879-967e-f669affa1cbc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:21.743531 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b368a732-37d3-4879-967e-f669affa1cbc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:21.753727 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b368a732-37d3-4879-967e-f669affa1cbc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:21.755363 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b368a732-37d3-4879-967e-f669affa1cbc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:21.760631 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b368a732-37d3-4879-967e-f669affa1cbc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:21.761547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b368a732-37d3-4879-967e-f669affa1cbc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:21.762159 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b368a732-37d3-4879-967e-f669affa1cbc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:21.762738 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b368a732-37d3-4879-967e-f669affa1cbc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:21.795818 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-55507bac-7b4c-4b33-9a3d-40c495f71353 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:21.805780 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-55507bac-7b4c-4b33-9a3d-40c495f71353 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.230640 Sep 15 12:59:21.807237 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 73/135] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:21 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:21.848964 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d8081e6b-2f25-41cf-8855-e7afa923d713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:21.849816 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d8081e6b-2f25-41cf-8855-e7afa923d713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:21.860620 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8081e6b-2f25-41cf-8855-e7afa923d713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:21.861352 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8081e6b-2f25-41cf-8855-e7afa923d713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:21.863283 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8081e6b-2f25-41cf-8855-e7afa923d713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:21.864161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8081e6b-2f25-41cf-8855-e7afa923d713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:21.867185 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8081e6b-2f25-41cf-8855-e7afa923d713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:21.867848 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8081e6b-2f25-41cf-8855-e7afa923d713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:21.996392 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b368a732-37d3-4879-967e-f669affa1cbc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:22.008055 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b368a732-37d3-4879-967e-f669affa1cbc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.270024 Sep 15 12:59:22.009213 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 63/136] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:21 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:22.042150 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-cac84a59-0ca9-408c-9777-c25a042c6ca3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:22.042888 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-cac84a59-0ca9-408c-9777-c25a042c6ca3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:22.056477 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cac84a59-0ca9-408c-9777-c25a042c6ca3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:22.056477 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cac84a59-0ca9-408c-9777-c25a042c6ca3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:22.056639 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cac84a59-0ca9-408c-9777-c25a042c6ca3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:22.057303 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cac84a59-0ca9-408c-9777-c25a042c6ca3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:22.057984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cac84a59-0ca9-408c-9777-c25a042c6ca3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:22.058405 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cac84a59-0ca9-408c-9777-c25a042c6ca3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:22.096707 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d8081e6b-2f25-41cf-8855-e7afa923d713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:22.112493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=100 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:22.115434 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d8081e6b-2f25-41cf-8855-e7afa923d713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:22.117308 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d8081e6b-2f25-41cf-8855-e7afa923d713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:22.118558 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d8081e6b-2f25-41cf-8855-e7afa923d713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.273474 Sep 15 12:59:22.119116 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 74/137] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:21 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:59:22.278162 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-cac84a59-0ca9-408c-9777-c25a042c6ca3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:22.279461 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4f71c096-556d-42a0-96be-92ed457e9f20 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:22.280070 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-4f71c096-556d-42a0-96be-92ed457e9f20 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:22.287335 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f71c096-556d-42a0-96be-92ed457e9f20 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:22.288038 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f71c096-556d-42a0-96be-92ed457e9f20 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:22.288521 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f71c096-556d-42a0-96be-92ed457e9f20 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:22.289360 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f71c096-556d-42a0-96be-92ed457e9f20 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:22.290309 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f71c096-556d-42a0-96be-92ed457e9f20 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:22.290696 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-cac84a59-0ca9-408c-9777-c25a042c6ca3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.258085 Sep 15 12:59:22.291093 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f71c096-556d-42a0-96be-92ed457e9f20 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:22.294439 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 64/138] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:22 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:22.832749 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-baf0808f-8d6c-4511-8041-28547a24c3fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:22.833619 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-baf0808f-8d6c-4511-8041-28547a24c3fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:22.842889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-baf0808f-8d6c-4511-8041-28547a24c3fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:22.843703 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-baf0808f-8d6c-4511-8041-28547a24c3fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:22.844757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-baf0808f-8d6c-4511-8041-28547a24c3fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:22.845866 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-baf0808f-8d6c-4511-8041-28547a24c3fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:22.846855 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-baf0808f-8d6c-4511-8041-28547a24c3fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:22.847625 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-baf0808f-8d6c-4511-8041-28547a24c3fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:22.904425 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4f71c096-556d-42a0-96be-92ed457e9f20 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:22.917760 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-4f71c096-556d-42a0-96be-92ed457e9f20 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 0.642112 Sep 15 12:59:22.919368 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 75/139] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:22 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:23.032871 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-aaf7ab75-6005-4d81-b3a1-febbea9ceb63 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:23.033492 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-aaf7ab75-6005-4d81-b3a1-febbea9ceb63 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:23.050314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab75-6005-4d81-b3a1-febbea9ceb63 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:23.050886 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab75-6005-4d81-b3a1-febbea9ceb63 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:23.052014 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab75-6005-4d81-b3a1-febbea9ceb63 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:23.056018 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab75-6005-4d81-b3a1-febbea9ceb63 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:23.057433 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab75-6005-4d81-b3a1-febbea9ceb63 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:23.057558 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab75-6005-4d81-b3a1-febbea9ceb63 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:23.063817 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-baf0808f-8d6c-4511-8041-28547a24c3fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:23.075784 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-baf0808f-8d6c-4511-8041-28547a24c3fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.248935 Sep 15 12:59:23.076707 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 65/140] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:22 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:23.149370 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a3d0b4b5-e529-4f25-9385-d258fb0f85f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:23.150274 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a3d0b4b5-e529-4f25-9385-d258fb0f85f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:23.157517 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a3d0b4b5-e529-4f25-9385-d258fb0f85f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:23.158225 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a3d0b4b5-e529-4f25-9385-d258fb0f85f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:23.158796 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a3d0b4b5-e529-4f25-9385-d258fb0f85f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:23.160082 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a3d0b4b5-e529-4f25-9385-d258fb0f85f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:23.160890 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a3d0b4b5-e529-4f25-9385-d258fb0f85f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:23.161550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a3d0b4b5-e529-4f25-9385-d258fb0f85f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:23.319821 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a3d0b4b5-e529-4f25-9385-d258fb0f85f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:23.330603 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a3d0b4b5-e529-4f25-9385-d258fb0f85f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:23.332684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a3d0b4b5-e529-4f25-9385-d258fb0f85f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:23.334036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a3d0b4b5-e529-4f25-9385-d258fb0f85f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.192183 Sep 15 12:59:23.334715 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 66/141] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:23 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:59:23.340950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-87838740-9605-4286-995c-2052578c820c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:23.342132 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-87838740-9605-4286-995c-2052578c820c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:23.346058 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=100 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:23.350334 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-87838740-9605-4286-995c-2052578c820c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:23.351218 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-87838740-9605-4286-995c-2052578c820c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:23.351851 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-87838740-9605-4286-995c-2052578c820c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:23.353391 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-87838740-9605-4286-995c-2052578c820c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:23.354192 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-87838740-9605-4286-995c-2052578c820c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:23.354688 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-87838740-9605-4286-995c-2052578c820c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:23.400309 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-aaf7ab75-6005-4d81-b3a1-febbea9ceb63 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:23.408182 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-aaf7ab75-6005-4d81-b3a1-febbea9ceb63 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.380772 Sep 15 12:59:23.410767 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 76/142] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:23 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:23.431596 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-4a3b86bb-fa4e-4cf0-b3bd-578c792b93bb req-b4acffde-500d-4453-ad6e-ad93e3bc55de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a7eade-1e1a-467f-a607-132c874cbb64", "name": "network-vif-plugged", "status": "completed", "tag": "c0f58aee-58a1-4953-8f6b-d92d148c0d4d"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:23.445686 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-4a3b86bb-fa4e-4cf0-b3bd-578c792b93bb req-b4acffde-500d-4453-ad6e-ad93e3bc55de service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:23.446566 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-4a3b86bb-fa4e-4cf0-b3bd-578c792b93bb req-b4acffde-500d-4453-ad6e-ad93e3bc55de service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:23.447325 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-4a3b86bb-fa4e-4cf0-b3bd-578c792b93bb req-b4acffde-500d-4453-ad6e-ad93e3bc55de service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:23.460083 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-4a3b86bb-fa4e-4cf0-b3bd-578c792b93bb req-b4acffde-500d-4453-ad6e-ad93e3bc55de service nova] Creating event network-vif-plugged:c0f58aee-58a1-4953-8f6b-d92d148c0d4d for instance f5a7eade-1e1a-467f-a607-132c874cbb64 on hv-cinder-83608 Sep 15 12:59:23.465979 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-4a3b86bb-fa4e-4cf0-b3bd-578c792b93bb req-b4acffde-500d-4453-ad6e-ad93e3bc55de service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048581 Sep 15 12:59:23.466908 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 77/143] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:59:23.506641 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-87838740-9605-4286-995c-2052578c820c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:23.521490 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-87838740-9605-4286-995c-2052578c820c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.178877 Sep 15 12:59:23.521490 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 67/144] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:23 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:23.953462 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-782f60be-8956-48b6-8f68-88381e953c42 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:23.954218 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-782f60be-8956-48b6-8f68-88381e953c42 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:23.962317 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-782f60be-8956-48b6-8f68-88381e953c42 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:23.963701 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-782f60be-8956-48b6-8f68-88381e953c42 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:23.964525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-782f60be-8956-48b6-8f68-88381e953c42 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:23.964964 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-782f60be-8956-48b6-8f68-88381e953c42 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:23.965873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-782f60be-8956-48b6-8f68-88381e953c42 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:23.966510 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-782f60be-8956-48b6-8f68-88381e953c42 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:24.105457 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-97910e28-60cb-48b9-b7ae-36a8072a0812 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:24.106606 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-97910e28-60cb-48b9-b7ae-36a8072a0812 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:24.126706 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97910e28-60cb-48b9-b7ae-36a8072a0812 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:24.127478 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97910e28-60cb-48b9-b7ae-36a8072a0812 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:24.127932 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97910e28-60cb-48b9-b7ae-36a8072a0812 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:24.128978 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97910e28-60cb-48b9-b7ae-36a8072a0812 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:24.129595 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97910e28-60cb-48b9-b7ae-36a8072a0812 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:24.130031 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97910e28-60cb-48b9-b7ae-36a8072a0812 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:24.147571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=100 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:24.178521 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-782f60be-8956-48b6-8f68-88381e953c42 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:24.186623 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-782f60be-8956-48b6-8f68-88381e953c42 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 0.248048 Sep 15 12:59:24.187223 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 78/145] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:23 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:24.297979 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-97910e28-60cb-48b9-b7ae-36a8072a0812 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:24.306953 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-97910e28-60cb-48b9-b7ae-36a8072a0812 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.207941 Sep 15 12:59:24.307534 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 68/146] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:24 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:24.360030 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-fd9d37cb-b02f-4c9e-9c8f-c080f3b44194 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:24.360698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-fd9d37cb-b02f-4c9e-9c8f-c080f3b44194 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:24.366912 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fd9d37cb-b02f-4c9e-9c8f-c080f3b44194 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:24.367590 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fd9d37cb-b02f-4c9e-9c8f-c080f3b44194 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:24.368254 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fd9d37cb-b02f-4c9e-9c8f-c080f3b44194 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:24.369196 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fd9d37cb-b02f-4c9e-9c8f-c080f3b44194 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:24.369644 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fd9d37cb-b02f-4c9e-9c8f-c080f3b44194 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:24.370061 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fd9d37cb-b02f-4c9e-9c8f-c080f3b44194 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:24.434395 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-af55eaa5-1294-4958-9c47-9dce39b77feb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:24.435258 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-af55eaa5-1294-4958-9c47-9dce39b77feb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:24.441661 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-af55eaa5-1294-4958-9c47-9dce39b77feb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:24.442430 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-af55eaa5-1294-4958-9c47-9dce39b77feb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:24.443067 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-af55eaa5-1294-4958-9c47-9dce39b77feb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:24.443952 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-af55eaa5-1294-4958-9c47-9dce39b77feb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:24.444629 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-af55eaa5-1294-4958-9c47-9dce39b77feb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:24.445220 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-af55eaa5-1294-4958-9c47-9dce39b77feb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:24.514141 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-fd9d37cb-b02f-4c9e-9c8f-c080f3b44194 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:24.522421 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-fd9d37cb-b02f-4c9e-9c8f-c080f3b44194 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:24.523857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-fd9d37cb-b02f-4c9e-9c8f-c080f3b44194 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:24.525597 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-fd9d37cb-b02f-4c9e-9c8f-c080f3b44194 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.169330 Sep 15 12:59:24.526344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 79/147] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:24 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:24.541826 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-533aee24-3f97-43de-825f-48225472f64f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:24.542435 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-533aee24-3f97-43de-825f-48225472f64f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:24.548584 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-533aee24-3f97-43de-825f-48225472f64f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:24.549058 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-533aee24-3f97-43de-825f-48225472f64f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:24.549488 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-533aee24-3f97-43de-825f-48225472f64f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:24.550200 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-533aee24-3f97-43de-825f-48225472f64f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:24.550649 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-533aee24-3f97-43de-825f-48225472f64f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:24.551062 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-533aee24-3f97-43de-825f-48225472f64f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:24.597399 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-af55eaa5-1294-4958-9c47-9dce39b77feb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:24.606890 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-af55eaa5-1294-4958-9c47-9dce39b77feb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.177611 Sep 15 12:59:24.607657 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 69/148] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:24 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:24.692983 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-533aee24-3f97-43de-825f-48225472f64f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:24.705282 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-533aee24-3f97-43de-825f-48225472f64f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.167389 Sep 15 12:59:24.705859 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 80/149] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:24 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:25.224466 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6f89e62f-f9e9-4c4a-8878-b8e390937071 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:25.224466 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6f89e62f-f9e9-4c4a-8878-b8e390937071 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:25.224466 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6f89e62f-f9e9-4c4a-8878-b8e390937071 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:25.224466 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6f89e62f-f9e9-4c4a-8878-b8e390937071 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:25.225282 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6f89e62f-f9e9-4c4a-8878-b8e390937071 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:25.225282 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6f89e62f-f9e9-4c4a-8878-b8e390937071 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:25.225282 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6f89e62f-f9e9-4c4a-8878-b8e390937071 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:25.225282 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6f89e62f-f9e9-4c4a-8878-b8e390937071 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:25.331087 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4f6363b2-c8a9-4e4b-8ac7-d39b0a3ff4c3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:25.331699 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-4f6363b2-c8a9-4e4b-8ac7-d39b0a3ff4c3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:25.339397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f6363b2-c8a9-4e4b-8ac7-d39b0a3ff4c3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:25.339900 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f6363b2-c8a9-4e4b-8ac7-d39b0a3ff4c3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:25.340379 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f6363b2-c8a9-4e4b-8ac7-d39b0a3ff4c3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:25.341284 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f6363b2-c8a9-4e4b-8ac7-d39b0a3ff4c3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:25.341923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f6363b2-c8a9-4e4b-8ac7-d39b0a3ff4c3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:25.342688 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4f6363b2-c8a9-4e4b-8ac7-d39b0a3ff4c3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:25.406156 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6f89e62f-f9e9-4c4a-8878-b8e390937071 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:25.418580 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6f89e62f-f9e9-4c4a-8878-b8e390937071 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1315 microversion: 2.1 time: 0.209813 Sep 15 12:59:25.419583 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 70/150] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:25 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:25.488752 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-4b51bc4f-3db1-4bc5-abea-bbf7bf1f6e9e req-5eed2ea6-bdb9-4950-9188-f4fef9eee4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7538af-56ab-4022-85eb-172a1ee55d71", "name": "network-vif-plugged", "status": "completed", "tag": "71e9592f-0e8b-403c-bbfd-bae6e0da6f5f"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:25.502923 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-4b51bc4f-3db1-4bc5-abea-bbf7bf1f6e9e req-5eed2ea6-bdb9-4950-9188-f4fef9eee4cd service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:25.503505 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-4b51bc4f-3db1-4bc5-abea-bbf7bf1f6e9e req-5eed2ea6-bdb9-4950-9188-f4fef9eee4cd service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:25.504442 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-4b51bc4f-3db1-4bc5-abea-bbf7bf1f6e9e req-5eed2ea6-bdb9-4950-9188-f4fef9eee4cd service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:25.526295 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-4b51bc4f-3db1-4bc5-abea-bbf7bf1f6e9e req-5eed2ea6-bdb9-4950-9188-f4fef9eee4cd service nova] Creating event network-vif-plugged:71e9592f-0e8b-403c-bbfd-bae6e0da6f5f for instance 2c7538af-56ab-4022-85eb-172a1ee55d71 on hv-cinder-83608 Sep 15 12:59:25.534955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-4b51bc4f-3db1-4bc5-abea-bbf7bf1f6e9e req-5eed2ea6-bdb9-4950-9188-f4fef9eee4cd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049639 Sep 15 12:59:25.536438 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 71/151] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:59:25.541508 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4f6363b2-c8a9-4e4b-8ac7-d39b0a3ff4c3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:25.550575 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-4f6363b2-c8a9-4e4b-8ac7-d39b0a3ff4c3 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.223211 Sep 15 12:59:25.551473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 81/152] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:25 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:25.560824 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c47ab08e-7986-40fa-b516-2854bc82d20a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:25.562129 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c47ab08e-7986-40fa-b516-2854bc82d20a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:25.569600 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c47ab08e-7986-40fa-b516-2854bc82d20a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:25.570352 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c47ab08e-7986-40fa-b516-2854bc82d20a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:25.571580 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c47ab08e-7986-40fa-b516-2854bc82d20a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:25.572026 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c47ab08e-7986-40fa-b516-2854bc82d20a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:25.572504 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c47ab08e-7986-40fa-b516-2854bc82d20a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:25.572951 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c47ab08e-7986-40fa-b516-2854bc82d20a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:25.631078 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c881df2a-240f-44ba-b82e-c9d97f014cfc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:25.632122 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c881df2a-240f-44ba-b82e-c9d97f014cfc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:25.650440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c881df2a-240f-44ba-b82e-c9d97f014cfc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:25.651129 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c881df2a-240f-44ba-b82e-c9d97f014cfc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:25.651569 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c881df2a-240f-44ba-b82e-c9d97f014cfc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:25.652279 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c881df2a-240f-44ba-b82e-c9d97f014cfc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:25.652747 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c881df2a-240f-44ba-b82e-c9d97f014cfc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:25.653161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c881df2a-240f-44ba-b82e-c9d97f014cfc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:25.802601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c47ab08e-7986-40fa-b516-2854bc82d20a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:25.813181 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c47ab08e-7986-40fa-b516-2854bc82d20a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:25.815255 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c47ab08e-7986-40fa-b516-2854bc82d20a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:25.816989 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c47ab08e-7986-40fa-b516-2854bc82d20a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.267789 Sep 15 12:59:25.818459 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 72/153] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:25 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:25.829507 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3fcfbb24-c8bc-4361-86ab-f0be8a43e38d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:25.830936 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3fcfbb24-c8bc-4361-86ab-f0be8a43e38d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:25.846410 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3fcfbb24-c8bc-4361-86ab-f0be8a43e38d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:25.847227 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3fcfbb24-c8bc-4361-86ab-f0be8a43e38d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:25.847491 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3fcfbb24-c8bc-4361-86ab-f0be8a43e38d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:25.848321 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3fcfbb24-c8bc-4361-86ab-f0be8a43e38d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:25.848869 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3fcfbb24-c8bc-4361-86ab-f0be8a43e38d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:25.849297 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3fcfbb24-c8bc-4361-86ab-f0be8a43e38d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:25.856113 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c881df2a-240f-44ba-b82e-c9d97f014cfc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:25.870016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c881df2a-240f-44ba-b82e-c9d97f014cfc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.242844 Sep 15 12:59:25.870602 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 82/154] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:25 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:26.062544 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3fcfbb24-c8bc-4361-86ab-f0be8a43e38d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:26.072514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3fcfbb24-c8bc-4361-86ab-f0be8a43e38d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.252570 Sep 15 12:59:26.074790 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 73/155] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:25 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:26.447579 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-37e16b60-f048-4c15-870b-b34d039158ac tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:26.448186 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-37e16b60-f048-4c15-870b-b34d039158ac tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:26.455038 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-37e16b60-f048-4c15-870b-b34d039158ac tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:26.455711 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-37e16b60-f048-4c15-870b-b34d039158ac tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:26.456140 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-37e16b60-f048-4c15-870b-b34d039158ac tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:26.457011 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-37e16b60-f048-4c15-870b-b34d039158ac tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:26.457456 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-37e16b60-f048-4c15-870b-b34d039158ac tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:26.457868 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-37e16b60-f048-4c15-870b-b34d039158ac tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:26.573985 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a2418cf0-274f-47ff-a83e-31ec3380c480 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:26.574590 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a2418cf0-274f-47ff-a83e-31ec3380c480 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:26.580642 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a2418cf0-274f-47ff-a83e-31ec3380c480 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:26.581125 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a2418cf0-274f-47ff-a83e-31ec3380c480 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:26.582505 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a2418cf0-274f-47ff-a83e-31ec3380c480 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:26.583196 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a2418cf0-274f-47ff-a83e-31ec3380c480 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:26.583646 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a2418cf0-274f-47ff-a83e-31ec3380c480 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:26.584061 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a2418cf0-274f-47ff-a83e-31ec3380c480 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:26.597765 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-37e16b60-f048-4c15-870b-b34d039158ac tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:26.606070 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-37e16b60-f048-4c15-870b-b34d039158ac tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1502 microversion: 2.1 time: 0.163176 Sep 15 12:59:26.606644 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 83/156] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:26 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:26.718321 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a2418cf0-274f-47ff-a83e-31ec3380c480 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:26.725831 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a2418cf0-274f-47ff-a83e-31ec3380c480 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.155736 Sep 15 12:59:26.726413 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 74/157] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:26 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:26.844619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-39299968-ef4e-404a-a5d2-9b55977b5be5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:26.845399 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-39299968-ef4e-404a-a5d2-9b55977b5be5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:26.852880 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-39299968-ef4e-404a-a5d2-9b55977b5be5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:26.853816 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-39299968-ef4e-404a-a5d2-9b55977b5be5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:26.854419 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-39299968-ef4e-404a-a5d2-9b55977b5be5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:26.855704 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-39299968-ef4e-404a-a5d2-9b55977b5be5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:26.856162 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-39299968-ef4e-404a-a5d2-9b55977b5be5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:26.856611 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-39299968-ef4e-404a-a5d2-9b55977b5be5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:26.894095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0e728b32-1be5-45f4-96ff-bbd316badb84 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:26.894826 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0e728b32-1be5-45f4-96ff-bbd316badb84 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:26.908160 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0e728b32-1be5-45f4-96ff-bbd316badb84 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:26.909174 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0e728b32-1be5-45f4-96ff-bbd316badb84 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:26.910169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0e728b32-1be5-45f4-96ff-bbd316badb84 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:26.911685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0e728b32-1be5-45f4-96ff-bbd316badb84 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:26.912370 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0e728b32-1be5-45f4-96ff-bbd316badb84 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:26.913582 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0e728b32-1be5-45f4-96ff-bbd316badb84 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:27.051827 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-39299968-ef4e-404a-a5d2-9b55977b5be5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:27.067931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-39299968-ef4e-404a-a5d2-9b55977b5be5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:27.069627 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0e728b32-1be5-45f4-96ff-bbd316badb84 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:27.069929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-39299968-ef4e-404a-a5d2-9b55977b5be5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:27.072633 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-39299968-ef4e-404a-a5d2-9b55977b5be5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.232901 Sep 15 12:59:27.073635 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 84/158] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:26 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:59:27.078233 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0e728b32-1be5-45f4-96ff-bbd316badb84 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.188268 Sep 15 12:59:27.078801 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 75/159] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:26 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:27.104910 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-60ed1164-6ac1-4f68-9066-fdc49bb6ae65 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:27.106542 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-60ed1164-6ac1-4f68-9066-fdc49bb6ae65 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:27.113254 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-60ed1164-6ac1-4f68-9066-fdc49bb6ae65 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:27.113750 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-60ed1164-6ac1-4f68-9066-fdc49bb6ae65 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:27.114190 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-60ed1164-6ac1-4f68-9066-fdc49bb6ae65 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:27.114989 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-60ed1164-6ac1-4f68-9066-fdc49bb6ae65 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:27.115455 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-60ed1164-6ac1-4f68-9066-fdc49bb6ae65 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:27.115866 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-60ed1164-6ac1-4f68-9066-fdc49bb6ae65 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:27.281040 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-60ed1164-6ac1-4f68-9066-fdc49bb6ae65 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:27.291254 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-60ed1164-6ac1-4f68-9066-fdc49bb6ae65 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.194069 Sep 15 12:59:27.291962 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 85/160] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:27 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:27.749247 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-cddedb63-058c-4391-ba26-f7b13171f7e7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:27.749854 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-cddedb63-058c-4391-ba26-f7b13171f7e7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:27.755670 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cddedb63-058c-4391-ba26-f7b13171f7e7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:27.756165 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cddedb63-058c-4391-ba26-f7b13171f7e7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:27.758305 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cddedb63-058c-4391-ba26-f7b13171f7e7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:27.759617 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cddedb63-058c-4391-ba26-f7b13171f7e7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:27.760110 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cddedb63-058c-4391-ba26-f7b13171f7e7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:27.760556 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cddedb63-058c-4391-ba26-f7b13171f7e7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:27.913913 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-cddedb63-058c-4391-ba26-f7b13171f7e7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:27.923156 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-cddedb63-058c-4391-ba26-f7b13171f7e7 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.177629 Sep 15 12:59:27.923729 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 76/161] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:27 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:28.101236 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-efecd4b7-54cf-4d7b-812b-2fd361e4a3c9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:28.102021 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-efecd4b7-54cf-4d7b-812b-2fd361e4a3c9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:28.105244 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1df0cd78-ca8a-4ef0-967d-a9c965999a8a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:28.105931 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1df0cd78-ca8a-4ef0-967d-a9c965999a8a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:28.108007 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efecd4b7-54cf-4d7b-812b-2fd361e4a3c9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:28.108529 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efecd4b7-54cf-4d7b-812b-2fd361e4a3c9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:28.108963 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efecd4b7-54cf-4d7b-812b-2fd361e4a3c9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:28.109649 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efecd4b7-54cf-4d7b-812b-2fd361e4a3c9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:28.110103 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efecd4b7-54cf-4d7b-812b-2fd361e4a3c9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:28.110521 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efecd4b7-54cf-4d7b-812b-2fd361e4a3c9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:28.113161 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1df0cd78-ca8a-4ef0-967d-a9c965999a8a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:28.114014 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1df0cd78-ca8a-4ef0-967d-a9c965999a8a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:28.114904 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1df0cd78-ca8a-4ef0-967d-a9c965999a8a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:28.115605 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1df0cd78-ca8a-4ef0-967d-a9c965999a8a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:28.116057 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1df0cd78-ca8a-4ef0-967d-a9c965999a8a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:28.116726 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1df0cd78-ca8a-4ef0-967d-a9c965999a8a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:28.252892 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-efecd4b7-54cf-4d7b-812b-2fd361e4a3c9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:28.261557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-efecd4b7-54cf-4d7b-812b-2fd361e4a3c9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:28.263038 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-efecd4b7-54cf-4d7b-812b-2fd361e4a3c9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:28.264174 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-efecd4b7-54cf-4d7b-812b-2fd361e4a3c9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.167053 Sep 15 12:59:28.264773 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 86/162] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:28 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:59:28.266963 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1df0cd78-ca8a-4ef0-967d-a9c965999a8a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:28.275771 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1df0cd78-ca8a-4ef0-967d-a9c965999a8a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.174441 Sep 15 12:59:28.276346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 77/163] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:28 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:28.314766 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-df8a0def-b8ee-4d01-a57c-8bf29284b235 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:28.315403 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-df8a0def-b8ee-4d01-a57c-8bf29284b235 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:28.317355 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:28.323454 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-df8a0def-b8ee-4d01-a57c-8bf29284b235 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:28.323929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-df8a0def-b8ee-4d01-a57c-8bf29284b235 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:28.324380 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-df8a0def-b8ee-4d01-a57c-8bf29284b235 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:28.325065 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-df8a0def-b8ee-4d01-a57c-8bf29284b235 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:28.325511 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-df8a0def-b8ee-4d01-a57c-8bf29284b235 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:28.325924 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-df8a0def-b8ee-4d01-a57c-8bf29284b235 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:28.463693 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-df8a0def-b8ee-4d01-a57c-8bf29284b235 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:28.471227 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-df8a0def-b8ee-4d01-a57c-8bf29284b235 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1368 microversion: 2.1 time: 0.160199 Sep 15 12:59:28.471777 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 87/164] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:28 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:28.946915 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-97767577-0f8d-441a-ac1a-14add4945db4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:28.947523 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-97767577-0f8d-441a-ac1a-14add4945db4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:28.953988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97767577-0f8d-441a-ac1a-14add4945db4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:28.954310 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97767577-0f8d-441a-ac1a-14add4945db4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:28.954746 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97767577-0f8d-441a-ac1a-14add4945db4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:28.955576 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97767577-0f8d-441a-ac1a-14add4945db4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:28.956037 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97767577-0f8d-441a-ac1a-14add4945db4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:28.956558 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97767577-0f8d-441a-ac1a-14add4945db4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:29.093275 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0d9ad010-09bb-4a29-90da-b47b5bedb2af tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2de65f8e-3e61-492c-ab75-5d2cf9aea628"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:29.095876 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0d9ad010-09bb-4a29-90da-b47b5bedb2af tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:29.104384 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0d9ad010-09bb-4a29-90da-b47b5bedb2af tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:29.104956 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0d9ad010-09bb-4a29-90da-b47b5bedb2af tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:29.105348 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0d9ad010-09bb-4a29-90da-b47b5bedb2af tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:29.106059 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0d9ad010-09bb-4a29-90da-b47b5bedb2af tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:29.107007 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0d9ad010-09bb-4a29-90da-b47b5bedb2af tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:29.107820 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0d9ad010-09bb-4a29-90da-b47b5bedb2af tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:29.161944 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-97767577-0f8d-441a-ac1a-14add4945db4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:29.174067 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-97767577-0f8d-441a-ac1a-14add4945db4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.229340 Sep 15 12:59:29.175032 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 78/165] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:28 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:29.292770 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-63462ee1-6ddb-4dff-9145-6627feba8032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:29.293485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-63462ee1-6ddb-4dff-9145-6627feba8032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:29.300076 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-63462ee1-6ddb-4dff-9145-6627feba8032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:29.300600 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-63462ee1-6ddb-4dff-9145-6627feba8032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:29.301630 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-63462ee1-6ddb-4dff-9145-6627feba8032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:29.302801 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-63462ee1-6ddb-4dff-9145-6627feba8032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:29.304228 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-63462ee1-6ddb-4dff-9145-6627feba8032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:29.304681 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-63462ee1-6ddb-4dff-9145-6627feba8032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:29.454421 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-63462ee1-6ddb-4dff-9145-6627feba8032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:29.464375 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-63462ee1-6ddb-4dff-9145-6627feba8032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:29.466149 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-63462ee1-6ddb-4dff-9145-6627feba8032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:29.467421 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-63462ee1-6ddb-4dff-9145-6627feba8032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.181024 Sep 15 12:59:29.485613 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 79/166] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:29 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:29.491556 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e3bc6796-33f3-4437-9fba-747b456dc5d7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:29.492529 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-e3bc6796-33f3-4437-9fba-747b456dc5d7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:29.499616 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e3bc6796-33f3-4437-9fba-747b456dc5d7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:29.500386 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e3bc6796-33f3-4437-9fba-747b456dc5d7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:29.500922 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e3bc6796-33f3-4437-9fba-747b456dc5d7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:29.501696 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e3bc6796-33f3-4437-9fba-747b456dc5d7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:29.502274 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e3bc6796-33f3-4437-9fba-747b456dc5d7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:29.502877 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e3bc6796-33f3-4437-9fba-747b456dc5d7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:29.655149 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e3bc6796-33f3-4437-9fba-747b456dc5d7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:29.672834 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e3bc6796-33f3-4437-9fba-747b456dc5d7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.185754 Sep 15 12:59:29.673507 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 80/167] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:29 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:29.679793 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-ddc4ddd5-444d-46e7-a2ca-accd8646d2ca req-dd6848d4-60c8-4dd1-95aa-027698a3c5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19c1c10-a0cf-4be2-907e-d210ec6cddbb", "name": "network-vif-plugged", "status": "completed", "tag": "f63af2cc-ef44-4098-a900-c09daa2c63e4"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:29.693512 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-ddc4ddd5-444d-46e7-a2ca-accd8646d2ca req-dd6848d4-60c8-4dd1-95aa-027698a3c5e1 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:29.694549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-ddc4ddd5-444d-46e7-a2ca-accd8646d2ca req-dd6848d4-60c8-4dd1-95aa-027698a3c5e1 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:29.695273 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-ddc4ddd5-444d-46e7-a2ca-accd8646d2ca req-dd6848d4-60c8-4dd1-95aa-027698a3c5e1 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:29.710216 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-ddc4ddd5-444d-46e7-a2ca-accd8646d2ca req-dd6848d4-60c8-4dd1-95aa-027698a3c5e1 service nova] Creating event network-vif-plugged:f63af2cc-ef44-4098-a900-c09daa2c63e4 for instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb on hv-cinder-83608 Sep 15 12:59:29.716385 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-ddc4ddd5-444d-46e7-a2ca-accd8646d2ca req-dd6848d4-60c8-4dd1-95aa-027698a3c5e1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041065 Sep 15 12:59:29.717196 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 81/168] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:59:29.722866 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1e305d86-47e8-4ea6-a142-0adc9a8fa5b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:29.723706 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1e305d86-47e8-4ea6-a142-0adc9a8fa5b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:29.732086 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e305d86-47e8-4ea6-a142-0adc9a8fa5b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:29.732782 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e305d86-47e8-4ea6-a142-0adc9a8fa5b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:29.733187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e305d86-47e8-4ea6-a142-0adc9a8fa5b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:29.733877 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e305d86-47e8-4ea6-a142-0adc9a8fa5b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:29.734322 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e305d86-47e8-4ea6-a142-0adc9a8fa5b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:29.734735 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e305d86-47e8-4ea6-a142-0adc9a8fa5b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:29.890957 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1e305d86-47e8-4ea6-a142-0adc9a8fa5b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:29.900345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1e305d86-47e8-4ea6-a142-0adc9a8fa5b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1558 microversion: 2.1 time: 0.181525 Sep 15 12:59:29.901000 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 82/169] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:29 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:29.928876 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1aa010f1-0ec3-43a4-ad25-c35dfb8bbfdd tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:29.929515 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1aa010f1-0ec3-43a4-ad25-c35dfb8bbfdd tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:29.936604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1aa010f1-0ec3-43a4-ad25-c35dfb8bbfdd tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:29.937361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1aa010f1-0ec3-43a4-ad25-c35dfb8bbfdd tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:29.937796 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1aa010f1-0ec3-43a4-ad25-c35dfb8bbfdd tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:29.938511 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1aa010f1-0ec3-43a4-ad25-c35dfb8bbfdd tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:29.938951 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1aa010f1-0ec3-43a4-ad25-c35dfb8bbfdd tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:29.939376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1aa010f1-0ec3-43a4-ad25-c35dfb8bbfdd tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:30.068750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1aa010f1-0ec3-43a4-ad25-c35dfb8bbfdd tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146845 Sep 15 12:59:30.069344 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 83/170] 10.222.0.57 () {58 vars in 1275 bytes} [Thu Sep 15 12:59:29 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:59:30.199260 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1d0a5c45-101f-48ab-96fc-a63e94baf15a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:30.199875 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1d0a5c45-101f-48ab-96fc-a63e94baf15a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:30.208387 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d0a5c45-101f-48ab-96fc-a63e94baf15a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:30.209561 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d0a5c45-101f-48ab-96fc-a63e94baf15a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:30.210204 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d0a5c45-101f-48ab-96fc-a63e94baf15a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:30.211456 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d0a5c45-101f-48ab-96fc-a63e94baf15a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:30.212705 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d0a5c45-101f-48ab-96fc-a63e94baf15a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:30.213625 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d0a5c45-101f-48ab-96fc-a63e94baf15a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:30.419787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1d0a5c45-101f-48ab-96fc-a63e94baf15a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:30.429710 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1d0a5c45-101f-48ab-96fc-a63e94baf15a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.235650 Sep 15 12:59:30.433437 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 84/171] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:30 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:30.493822 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c6977a1d-dff5-4623-a821-f3ed9d90f45c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:30.494938 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c6977a1d-dff5-4623-a821-f3ed9d90f45c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:30.502677 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c6977a1d-dff5-4623-a821-f3ed9d90f45c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:30.505083 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c6977a1d-dff5-4623-a821-f3ed9d90f45c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:30.505904 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c6977a1d-dff5-4623-a821-f3ed9d90f45c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:30.506907 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c6977a1d-dff5-4623-a821-f3ed9d90f45c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:30.507536 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c6977a1d-dff5-4623-a821-f3ed9d90f45c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:30.508107 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c6977a1d-dff5-4623-a821-f3ed9d90f45c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:30.762656 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c6977a1d-dff5-4623-a821-f3ed9d90f45c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:30.782120 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0d9ad010-09bb-4a29-90da-b47b5bedb2af tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "POST /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.694245 Sep 15 12:59:30.790739 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c6977a1d-dff5-4623-a821-f3ed9d90f45c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:30.790739 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c6977a1d-dff5-4623-a821-f3ed9d90f45c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:30.791052 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 88/172] 10.222.0.57 () {60 vars in 1323 bytes} [Thu Sep 15 12:59:29 2022] POST /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992/os-volume_attachments => generated 194 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 15 12:59:30.794616 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c6977a1d-dff5-4623-a821-f3ed9d90f45c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.299312 Sep 15 12:59:30.795300 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 85/173] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:30 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:30.818482 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5d1bec38-c241-4011-821e-73e4615c5daa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:30.819259 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-5d1bec38-c241-4011-821e-73e4615c5daa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:30.835581 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5d1bec38-c241-4011-821e-73e4615c5daa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:30.836347 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5d1bec38-c241-4011-821e-73e4615c5daa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:30.837004 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5d1bec38-c241-4011-821e-73e4615c5daa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:30.838476 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5d1bec38-c241-4011-821e-73e4615c5daa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:30.845727 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5d1bec38-c241-4011-821e-73e4615c5daa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:30.846410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5d1bec38-c241-4011-821e-73e4615c5daa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:31.458030 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ec9b7a51-8217-49fb-8f54-8ceaa37a848f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:31.458648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ec9b7a51-8217-49fb-8f54-8ceaa37a848f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:31.467344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-5d1bec38-c241-4011-821e-73e4615c5daa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:31.469034 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ec9b7a51-8217-49fb-8f54-8ceaa37a848f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:31.470302 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ec9b7a51-8217-49fb-8f54-8ceaa37a848f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:31.472514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ec9b7a51-8217-49fb-8f54-8ceaa37a848f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:31.473966 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ec9b7a51-8217-49fb-8f54-8ceaa37a848f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:31.475453 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ec9b7a51-8217-49fb-8f54-8ceaa37a848f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:31.477254 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ec9b7a51-8217-49fb-8f54-8ceaa37a848f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:31.484889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-5d1bec38-c241-4011-821e-73e4615c5daa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.691962 Sep 15 12:59:31.485765 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 89/174] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:30 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:31.657789 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ec9b7a51-8217-49fb-8f54-8ceaa37a848f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:31.660070 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=100 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:31.667531 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ec9b7a51-8217-49fb-8f54-8ceaa37a848f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1362 microversion: 2.1 time: 0.215021 Sep 15 12:59:31.668109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 86/175] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:31 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:31.732452 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-ef7211b6-8b54-4166-863d-4cb778d3a475 req-0f6d0467-e526-40b5-b619-1963f94977b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1777381a-01af-43ba-98dc-31bfeeded7bb", "name": "network-vif-plugged", "status": "completed", "tag": "12b0a8a8-4a84-4e3e-8e96-e6939fe11e18"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:31.742542 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-ef7211b6-8b54-4166-863d-4cb778d3a475 req-0f6d0467-e526-40b5-b619-1963f94977b5 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:31.743251 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-ef7211b6-8b54-4166-863d-4cb778d3a475 req-0f6d0467-e526-40b5-b619-1963f94977b5 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:31.744029 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-ef7211b6-8b54-4166-863d-4cb778d3a475 req-0f6d0467-e526-40b5-b619-1963f94977b5 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:31.756959 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-ef7211b6-8b54-4166-863d-4cb778d3a475 req-0f6d0467-e526-40b5-b619-1963f94977b5 service nova] Creating event network-vif-plugged:12b0a8a8-4a84-4e3e-8e96-e6939fe11e18 for instance 1777381a-01af-43ba-98dc-31bfeeded7bb on hv-cinder-83608 Sep 15 12:59:31.762622 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-ef7211b6-8b54-4166-863d-4cb778d3a475 req-0f6d0467-e526-40b5-b619-1963f94977b5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034128 Sep 15 12:59:31.763437 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 90/176] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:59:31.819335 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5ae3e8e0-dffe-4411-8428-52f70a1e3a17 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:31.820195 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5ae3e8e0-dffe-4411-8428-52f70a1e3a17 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:31.827113 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5ae3e8e0-dffe-4411-8428-52f70a1e3a17 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:31.827918 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5ae3e8e0-dffe-4411-8428-52f70a1e3a17 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:31.828542 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5ae3e8e0-dffe-4411-8428-52f70a1e3a17 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:31.829231 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5ae3e8e0-dffe-4411-8428-52f70a1e3a17 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:31.829916 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5ae3e8e0-dffe-4411-8428-52f70a1e3a17 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:31.830710 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5ae3e8e0-dffe-4411-8428-52f70a1e3a17 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:32.110815 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5ae3e8e0-dffe-4411-8428-52f70a1e3a17 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:32.125036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5ae3e8e0-dffe-4411-8428-52f70a1e3a17 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:32.126929 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5ae3e8e0-dffe-4411-8428-52f70a1e3a17 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:32.128310 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5ae3e8e0-dffe-4411-8428-52f70a1e3a17 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.312947 Sep 15 12:59:32.129040 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 87/177] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:31 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:32.278453 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-91cf377d-a2d0-4762-9946-e437a54da46c req-6305422b-d09d-4bc1-9d17-65ff069bbe1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a48c801-810d-4702-a905-a6109e4786d8", "tag": "15fae3ac-3d15-4151-bd85-4686ea0f64b1"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:32.294263 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-91cf377d-a2d0-4762-9946-e437a54da46c req-6305422b-d09d-4bc1-9d17-65ff069bbe1c service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:32.294796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-91cf377d-a2d0-4762-9946-e437a54da46c req-6305422b-d09d-4bc1-9d17-65ff069bbe1c service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:32.299516 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-91cf377d-a2d0-4762-9946-e437a54da46c req-6305422b-d09d-4bc1-9d17-65ff069bbe1c service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:32.328013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-91cf377d-a2d0-4762-9946-e437a54da46c req-6305422b-d09d-4bc1-9d17-65ff069bbe1c service nova] Creating event network-changed:15fae3ac-3d15-4151-bd85-4686ea0f64b1 for instance 7a48c801-810d-4702-a905-a6109e4786d8 on hv-cinder-83608 Sep 15 12:59:32.347900 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-91cf377d-a2d0-4762-9946-e437a54da46c req-6305422b-d09d-4bc1-9d17-65ff069bbe1c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073431 Sep 15 12:59:32.349779 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 91/178] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:59:32.509894 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6a5aa28c-8c03-4e83-8b7b-b24b44d5ca82 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:32.511647 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6a5aa28c-8c03-4e83-8b7b-b24b44d5ca82 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:32.519344 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6a5aa28c-8c03-4e83-8b7b-b24b44d5ca82 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:32.520434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6a5aa28c-8c03-4e83-8b7b-b24b44d5ca82 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:32.521054 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6a5aa28c-8c03-4e83-8b7b-b24b44d5ca82 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:32.521942 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6a5aa28c-8c03-4e83-8b7b-b24b44d5ca82 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:32.522577 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6a5aa28c-8c03-4e83-8b7b-b24b44d5ca82 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:32.523216 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6a5aa28c-8c03-4e83-8b7b-b24b44d5ca82 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:32.691662 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-efb88981-39b6-49aa-a629-6e2c1c55e83c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:32.692897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-efb88981-39b6-49aa-a629-6e2c1c55e83c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:32.757073 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efb88981-39b6-49aa-a629-6e2c1c55e83c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:32.763366 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efb88981-39b6-49aa-a629-6e2c1c55e83c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:32.763995 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efb88981-39b6-49aa-a629-6e2c1c55e83c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:32.766514 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efb88981-39b6-49aa-a629-6e2c1c55e83c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:32.770287 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efb88981-39b6-49aa-a629-6e2c1c55e83c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:32.770575 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6a5aa28c-8c03-4e83-8b7b-b24b44d5ca82 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:32.771422 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efb88981-39b6-49aa-a629-6e2c1c55e83c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:32.779812 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6a5aa28c-8c03-4e83-8b7b-b24b44d5ca82 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.274858 Sep 15 12:59:32.781424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:32.801971 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 88/179] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:32 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:33.039150 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-efb88981-39b6-49aa-a629-6e2c1c55e83c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:33.058132 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-efb88981-39b6-49aa-a629-6e2c1c55e83c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1546 microversion: 2.1 time: 0.368600 Sep 15 12:59:33.060400 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 92/180] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:32 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1546 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:33.089722 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c8be1ad5-8a76-4ebd-b570-e6ec3d08285c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:33.090401 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c8be1ad5-8a76-4ebd-b570-e6ec3d08285c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:33.114310 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8be1ad5-8a76-4ebd-b570-e6ec3d08285c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:33.117075 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8be1ad5-8a76-4ebd-b570-e6ec3d08285c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:33.120844 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8be1ad5-8a76-4ebd-b570-e6ec3d08285c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:33.121593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8be1ad5-8a76-4ebd-b570-e6ec3d08285c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:33.122057 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8be1ad5-8a76-4ebd-b570-e6ec3d08285c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:33.122484 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8be1ad5-8a76-4ebd-b570-e6ec3d08285c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:33.163832 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-6d8d5f42-7879-4660-9141-5a426dd2e392 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:33.164368 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-6d8d5f42-7879-4660-9141-5a426dd2e392 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:33.170779 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6d8d5f42-7879-4660-9141-5a426dd2e392 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:33.171266 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6d8d5f42-7879-4660-9141-5a426dd2e392 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:33.171696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6d8d5f42-7879-4660-9141-5a426dd2e392 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:33.172425 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6d8d5f42-7879-4660-9141-5a426dd2e392 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:33.172895 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6d8d5f42-7879-4660-9141-5a426dd2e392 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:33.173282 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6d8d5f42-7879-4660-9141-5a426dd2e392 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:33.273676 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c8be1ad5-8a76-4ebd-b570-e6ec3d08285c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188978 Sep 15 12:59:33.274259 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 89/181] 10.222.0.57 () {58 vars in 1275 bytes} [Thu Sep 15 12:59:33 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:59:33.554895 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-6d8d5f42-7879-4660-9141-5a426dd2e392 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:33.582092 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-6d8d5f42-7879-4660-9141-5a426dd2e392 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:33.585083 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-6d8d5f42-7879-4660-9141-5a426dd2e392 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:33.586756 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-6d8d5f42-7879-4660-9141-5a426dd2e392 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.429198 Sep 15 12:59:33.588166 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 93/182] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:33 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:59:33.807622 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0ba31eaf-e2ad-461d-ab89-c5a639d540f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:33.808568 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0ba31eaf-e2ad-461d-ab89-c5a639d540f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:33.823805 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0ba31eaf-e2ad-461d-ab89-c5a639d540f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:33.824662 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0ba31eaf-e2ad-461d-ab89-c5a639d540f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:33.825273 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0ba31eaf-e2ad-461d-ab89-c5a639d540f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:33.826164 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0ba31eaf-e2ad-461d-ab89-c5a639d540f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:33.826919 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0ba31eaf-e2ad-461d-ab89-c5a639d540f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:33.827619 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0ba31eaf-e2ad-461d-ab89-c5a639d540f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:34.616646 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-06cdf8e1-61d6-4f86-8748-a80327b4605e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:34.618809 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-06cdf8e1-61d6-4f86-8748-a80327b4605e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:34.630483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-06cdf8e1-61d6-4f86-8748-a80327b4605e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:34.632382 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-06cdf8e1-61d6-4f86-8748-a80327b4605e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:34.633446 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-06cdf8e1-61d6-4f86-8748-a80327b4605e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:34.635009 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-06cdf8e1-61d6-4f86-8748-a80327b4605e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:34.636385 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-06cdf8e1-61d6-4f86-8748-a80327b4605e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:34.637152 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-06cdf8e1-61d6-4f86-8748-a80327b4605e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:34.643990 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0ba31eaf-e2ad-461d-ab89-c5a639d540f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:34.656381 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0ba31eaf-e2ad-461d-ab89-c5a639d540f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1321 microversion: 2.1 time: 0.852834 Sep 15 12:59:34.672301 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 90/183] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:33 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1321 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:34.936902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-06cdf8e1-61d6-4f86-8748-a80327b4605e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:34.947520 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-06cdf8e1-61d6-4f86-8748-a80327b4605e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:34.949399 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-06cdf8e1-61d6-4f86-8748-a80327b4605e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:34.950527 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-06cdf8e1-61d6-4f86-8748-a80327b4605e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.339713 Sep 15 12:59:34.960725 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 94/184] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:34 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:35.345784 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-ea832d44-6b63-47fd-9fb0-d23af634210b req-9bc15857-05b7-40bb-8b80-35f53f8b75fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7538af-56ab-4022-85eb-172a1ee55d71", "tag": "71e9592f-0e8b-403c-bbfd-bae6e0da6f5f"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:35.360939 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-ea832d44-6b63-47fd-9fb0-d23af634210b req-9bc15857-05b7-40bb-8b80-35f53f8b75fd service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:35.361412 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-ea832d44-6b63-47fd-9fb0-d23af634210b req-9bc15857-05b7-40bb-8b80-35f53f8b75fd service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:35.365221 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-ea832d44-6b63-47fd-9fb0-d23af634210b req-9bc15857-05b7-40bb-8b80-35f53f8b75fd service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:35.378389 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-ea832d44-6b63-47fd-9fb0-d23af634210b req-9bc15857-05b7-40bb-8b80-35f53f8b75fd service nova] Creating event network-changed:71e9592f-0e8b-403c-bbfd-bae6e0da6f5f for instance 2c7538af-56ab-4022-85eb-172a1ee55d71 on hv-cinder-83608 Sep 15 12:59:35.385348 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-ea832d44-6b63-47fd-9fb0-d23af634210b req-9bc15857-05b7-40bb-8b80-35f53f8b75fd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043192 Sep 15 12:59:35.386176 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 91/185] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:59:35.686627 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b1636b84-1bee-40c5-b359-9d0a5c00b964 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:35.688082 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b1636b84-1bee-40c5-b359-9d0a5c00b964 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:35.696073 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=100 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:35.698488 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b1636b84-1bee-40c5-b359-9d0a5c00b964 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:35.699088 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b1636b84-1bee-40c5-b359-9d0a5c00b964 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:35.699754 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b1636b84-1bee-40c5-b359-9d0a5c00b964 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:35.700714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b1636b84-1bee-40c5-b359-9d0a5c00b964 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:35.701355 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b1636b84-1bee-40c5-b359-9d0a5c00b964 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:35.702002 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b1636b84-1bee-40c5-b359-9d0a5c00b964 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:35.895968 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b1636b84-1bee-40c5-b359-9d0a5c00b964 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:35.905110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b1636b84-1bee-40c5-b359-9d0a5c00b964 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1516 microversion: 2.1 time: 0.222769 Sep 15 12:59:35.905694 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 95/186] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:35 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1516 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:35.932660 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-378da6f0-e121-4794-b93a-08f947b70e30 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:35.934908 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-378da6f0-e121-4794-b93a-08f947b70e30 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:35.942642 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-378da6f0-e121-4794-b93a-08f947b70e30 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:35.943133 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-378da6f0-e121-4794-b93a-08f947b70e30 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:35.943744 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-378da6f0-e121-4794-b93a-08f947b70e30 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:35.944932 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-378da6f0-e121-4794-b93a-08f947b70e30 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:35.945535 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-378da6f0-e121-4794-b93a-08f947b70e30 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:35.946108 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-378da6f0-e121-4794-b93a-08f947b70e30 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:35.977015 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e651a2f1-0315-47d4-b280-2e710ea064cc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:35.977186 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-378da6f0-e121-4794-b93a-08f947b70e30 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lazy-loading 'flavor' on Instance uuid f5a7eade-1e1a-467f-a607-132c874cbb64 {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:59:35.978146 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e651a2f1-0315-47d4-b280-2e710ea064cc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:35.986475 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e651a2f1-0315-47d4-b280-2e710ea064cc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:35.987367 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e651a2f1-0315-47d4-b280-2e710ea064cc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:35.988075 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e651a2f1-0315-47d4-b280-2e710ea064cc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:35.989610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e651a2f1-0315-47d4-b280-2e710ea064cc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:35.991044 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e651a2f1-0315-47d4-b280-2e710ea064cc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:35.991861 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e651a2f1-0315-47d4-b280-2e710ea064cc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:36.145875 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-378da6f0-e121-4794-b93a-08f947b70e30 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "POST /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64/action" status: 200 len: 32 microversion: 2.1 time: 0.215635 Sep 15 12:59:36.147838 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 92/187] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Sep 15 12:59:35 2022] POST /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64/action => generated 32 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 12:59:36.167218 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b58d66e8-dc5f-4976-82b6-d2e058196abd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:36.167937 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b58d66e8-dc5f-4976-82b6-d2e058196abd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:36.183909 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b58d66e8-dc5f-4976-82b6-d2e058196abd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:36.185620 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b58d66e8-dc5f-4976-82b6-d2e058196abd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:36.186073 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b58d66e8-dc5f-4976-82b6-d2e058196abd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:36.186787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b58d66e8-dc5f-4976-82b6-d2e058196abd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:36.187242 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b58d66e8-dc5f-4976-82b6-d2e058196abd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:36.187664 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b58d66e8-dc5f-4976-82b6-d2e058196abd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:36.306135 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e651a2f1-0315-47d4-b280-2e710ea064cc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:36.316156 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e651a2f1-0315-47d4-b280-2e710ea064cc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:36.320610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e651a2f1-0315-47d4-b280-2e710ea064cc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:36.323644 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e651a2f1-0315-47d4-b280-2e710ea064cc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.350873 Sep 15 12:59:36.344815 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 96/188] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:35 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:59:36.413243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b58d66e8-dc5f-4976-82b6-d2e058196abd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:36.425234 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b58d66e8-dc5f-4976-82b6-d2e058196abd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.270221 Sep 15 12:59:36.426129 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 93/189] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:36 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:37.351077 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c306ef20-6b85-440b-968a-d50fcb35e142 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:37.351831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c306ef20-6b85-440b-968a-d50fcb35e142 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:37.361371 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c306ef20-6b85-440b-968a-d50fcb35e142 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:37.362520 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c306ef20-6b85-440b-968a-d50fcb35e142 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:37.363829 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c306ef20-6b85-440b-968a-d50fcb35e142 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:37.364638 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c306ef20-6b85-440b-968a-d50fcb35e142 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:37.365095 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c306ef20-6b85-440b-968a-d50fcb35e142 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:37.365546 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c306ef20-6b85-440b-968a-d50fcb35e142 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:37.452244 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-dca4f657-d6ab-4b17-b7ef-9785d00e5ff2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:37.452908 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-dca4f657-d6ab-4b17-b7ef-9785d00e5ff2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:37.465041 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dca4f657-d6ab-4b17-b7ef-9785d00e5ff2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:37.465543 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dca4f657-d6ab-4b17-b7ef-9785d00e5ff2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:37.465975 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dca4f657-d6ab-4b17-b7ef-9785d00e5ff2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:37.468345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dca4f657-d6ab-4b17-b7ef-9785d00e5ff2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:37.470862 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dca4f657-d6ab-4b17-b7ef-9785d00e5ff2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:37.471305 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dca4f657-d6ab-4b17-b7ef-9785d00e5ff2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:37.640455 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c306ef20-6b85-440b-968a-d50fcb35e142 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:37.650760 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c306ef20-6b85-440b-968a-d50fcb35e142 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:37.652554 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c306ef20-6b85-440b-968a-d50fcb35e142 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:37.653931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c306ef20-6b85-440b-968a-d50fcb35e142 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.306840 Sep 15 12:59:37.655619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 97/190] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:37 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:37.699802 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-dca4f657-d6ab-4b17-b7ef-9785d00e5ff2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:37.710611 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-dca4f657-d6ab-4b17-b7ef-9785d00e5ff2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.262789 Sep 15 12:59:37.711301 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 94/191] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:37 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:38.680729 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-08ee13be-02f6-468c-ab4e-7430939c3ec2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:38.682011 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-08ee13be-02f6-468c-ab4e-7430939c3ec2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:38.688508 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-08ee13be-02f6-468c-ab4e-7430939c3ec2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:38.689065 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-08ee13be-02f6-468c-ab4e-7430939c3ec2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:38.689713 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-08ee13be-02f6-468c-ab4e-7430939c3ec2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:38.690532 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-08ee13be-02f6-468c-ab4e-7430939c3ec2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:38.691056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-08ee13be-02f6-468c-ab4e-7430939c3ec2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:38.691481 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-08ee13be-02f6-468c-ab4e-7430939c3ec2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:38.734228 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0f23ab56-bc3a-4304-b198-c003c679f4c5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:38.735589 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0f23ab56-bc3a-4304-b198-c003c679f4c5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:38.741672 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f23ab56-bc3a-4304-b198-c003c679f4c5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:38.742381 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f23ab56-bc3a-4304-b198-c003c679f4c5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:38.743211 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f23ab56-bc3a-4304-b198-c003c679f4c5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:38.743732 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f23ab56-bc3a-4304-b198-c003c679f4c5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:38.744191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f23ab56-bc3a-4304-b198-c003c679f4c5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:38.744648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f23ab56-bc3a-4304-b198-c003c679f4c5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:38.881055 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-08ee13be-02f6-468c-ab4e-7430939c3ec2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:38.896198 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-08ee13be-02f6-468c-ab4e-7430939c3ec2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:38.900714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-08ee13be-02f6-468c-ab4e-7430939c3ec2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:38.902177 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-08ee13be-02f6-468c-ab4e-7430939c3ec2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1407 microversion: 2.20 time: 0.225599 Sep 15 12:59:38.903207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 98/192] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:38 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:59:38.924073 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0f23ab56-bc3a-4304-b198-c003c679f4c5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:38.937098 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0f23ab56-bc3a-4304-b198-c003c679f4c5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.206670 Sep 15 12:59:38.937869 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 95/193] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:38 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:39.927498 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2af3b090-468c-4171-b254-4e896cad8981 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:39.928099 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2af3b090-468c-4171-b254-4e896cad8981 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:39.934770 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2af3b090-468c-4171-b254-4e896cad8981 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:39.935259 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2af3b090-468c-4171-b254-4e896cad8981 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:39.935693 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2af3b090-468c-4171-b254-4e896cad8981 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:39.936412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2af3b090-468c-4171-b254-4e896cad8981 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:39.936867 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2af3b090-468c-4171-b254-4e896cad8981 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:39.937288 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2af3b090-468c-4171-b254-4e896cad8981 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:39.962721 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-37cba2a2-ebe6-41c2-9e70-babc6f085cc8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:39.963430 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-37cba2a2-ebe6-41c2-9e70-babc6f085cc8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:39.969871 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-37cba2a2-ebe6-41c2-9e70-babc6f085cc8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:39.970440 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-37cba2a2-ebe6-41c2-9e70-babc6f085cc8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:39.970960 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-37cba2a2-ebe6-41c2-9e70-babc6f085cc8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:39.971725 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-37cba2a2-ebe6-41c2-9e70-babc6f085cc8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:39.972297 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-37cba2a2-ebe6-41c2-9e70-babc6f085cc8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:39.972792 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-37cba2a2-ebe6-41c2-9e70-babc6f085cc8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:40.095534 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2af3b090-468c-4171-b254-4e896cad8981 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:40.121160 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2af3b090-468c-4171-b254-4e896cad8981 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:40.123790 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2af3b090-468c-4171-b254-4e896cad8981 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:40.125782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2af3b090-468c-4171-b254-4e896cad8981 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1599 microversion: 2.20 time: 0.202248 Sep 15 12:59:40.134309 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 99/194] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 12:59:39 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:59:40.144824 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-37cba2a2-ebe6-41c2-9e70-babc6f085cc8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:40.153500 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4fda5e49-60fb-46b6-baa2-7215a3533400 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:40.154175 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-4fda5e49-60fb-46b6-baa2-7215a3533400 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:40.155934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-37cba2a2-ebe6-41c2-9e70-babc6f085cc8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.197758 Sep 15 12:59:40.156711 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 96/195] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:39 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:59:40.160437 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4fda5e49-60fb-46b6-baa2-7215a3533400 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:40.161258 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4fda5e49-60fb-46b6-baa2-7215a3533400 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:40.161832 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4fda5e49-60fb-46b6-baa2-7215a3533400 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:40.162663 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4fda5e49-60fb-46b6-baa2-7215a3533400 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:40.163413 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4fda5e49-60fb-46b6-baa2-7215a3533400 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:40.163969 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4fda5e49-60fb-46b6-baa2-7215a3533400 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:40.256739 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-4fda5e49-60fb-46b6-baa2-7215a3533400 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107953 Sep 15 12:59:40.265411 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 100/196] 10.222.0.57 () {60 vars in 1316 bytes} [Thu Sep 15 12:59:40 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 12:59:41.179696 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-9df7abc0-4355-4c7f-995d-e86683a840b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:41.181870 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-9df7abc0-4355-4c7f-995d-e86683a840b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:41.190003 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9df7abc0-4355-4c7f-995d-e86683a840b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:41.191086 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9df7abc0-4355-4c7f-995d-e86683a840b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:41.192262 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9df7abc0-4355-4c7f-995d-e86683a840b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:41.194584 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9df7abc0-4355-4c7f-995d-e86683a840b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:41.195329 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9df7abc0-4355-4c7f-995d-e86683a840b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:41.196086 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9df7abc0-4355-4c7f-995d-e86683a840b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:41.521013 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9df7abc0-4355-4c7f-995d-e86683a840b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:41.535230 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-9df7abc0-4355-4c7f-995d-e86683a840b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.359527 Sep 15 12:59:41.537686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 97/197] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:41 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:41.892229 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-5947208b-7e74-430b-9741-51843bc95fe4 req-c3770ce1-9c70-4a27-b678-2bdef5934000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1777381a-01af-43ba-98dc-31bfeeded7bb", "tag": "12b0a8a8-4a84-4e3e-8e96-e6939fe11e18"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:41.911512 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-5947208b-7e74-430b-9741-51843bc95fe4 req-c3770ce1-9c70-4a27-b678-2bdef5934000 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:41.912021 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-5947208b-7e74-430b-9741-51843bc95fe4 req-c3770ce1-9c70-4a27-b678-2bdef5934000 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:41.912899 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-5947208b-7e74-430b-9741-51843bc95fe4 req-c3770ce1-9c70-4a27-b678-2bdef5934000 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:41.927303 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-5947208b-7e74-430b-9741-51843bc95fe4 req-c3770ce1-9c70-4a27-b678-2bdef5934000 service nova] Creating event network-changed:12b0a8a8-4a84-4e3e-8e96-e6939fe11e18 for instance 1777381a-01af-43ba-98dc-31bfeeded7bb on hv-cinder-83608 Sep 15 12:59:41.936060 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-5947208b-7e74-430b-9741-51843bc95fe4 req-c3770ce1-9c70-4a27-b678-2bdef5934000 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045894 Sep 15 12:59:41.937224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 101/198] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:59:42.562932 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d64a6053-6d44-42c2-982c-63300e728a24 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:42.563550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d64a6053-6d44-42c2-982c-63300e728a24 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:42.569812 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d64a6053-6d44-42c2-982c-63300e728a24 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:42.570500 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d64a6053-6d44-42c2-982c-63300e728a24 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:42.570972 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d64a6053-6d44-42c2-982c-63300e728a24 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:42.571823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d64a6053-6d44-42c2-982c-63300e728a24 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:42.572291 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d64a6053-6d44-42c2-982c-63300e728a24 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:42.572712 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d64a6053-6d44-42c2-982c-63300e728a24 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:42.720821 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d64a6053-6d44-42c2-982c-63300e728a24 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:42.731021 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d64a6053-6d44-42c2-982c-63300e728a24 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.172546 Sep 15 12:59:42.731888 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 98/199] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:42 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:43.756543 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-54b4f173-f3f0-4ff4-bb76-2aaac4bfec47 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:43.757248 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-54b4f173-f3f0-4ff4-bb76-2aaac4bfec47 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:43.763385 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-54b4f173-f3f0-4ff4-bb76-2aaac4bfec47 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:43.763877 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-54b4f173-f3f0-4ff4-bb76-2aaac4bfec47 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:43.764327 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-54b4f173-f3f0-4ff4-bb76-2aaac4bfec47 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:43.765022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-54b4f173-f3f0-4ff4-bb76-2aaac4bfec47 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:43.765473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-54b4f173-f3f0-4ff4-bb76-2aaac4bfec47 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:43.765891 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-54b4f173-f3f0-4ff4-bb76-2aaac4bfec47 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:43.906118 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-54b4f173-f3f0-4ff4-bb76-2aaac4bfec47 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:43.914516 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-54b4f173-f3f0-4ff4-bb76-2aaac4bfec47 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.162660 Sep 15 12:59:43.915761 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 102/200] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:43 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:44.274413 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-dbc20b17-a9bd-4b3b-8960-8a4142b46610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:44.275263 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-dbc20b17-a9bd-4b3b-8960-8a4142b46610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:44.281328 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dbc20b17-a9bd-4b3b-8960-8a4142b46610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:44.281827 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dbc20b17-a9bd-4b3b-8960-8a4142b46610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:44.282279 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dbc20b17-a9bd-4b3b-8960-8a4142b46610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:44.283369 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dbc20b17-a9bd-4b3b-8960-8a4142b46610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:44.283996 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dbc20b17-a9bd-4b3b-8960-8a4142b46610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:44.284599 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dbc20b17-a9bd-4b3b-8960-8a4142b46610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:44.312572 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-dbc20b17-a9bd-4b3b-8960-8a4142b46610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Going to try to terminate instance {{(pid=120634) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:59:44.407824 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-dbc20b17-a9bd-4b3b-8960-8a4142b46610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 204 len: 0 microversion: 2.1 time: 0.138913 Sep 15 12:59:44.408881 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 99/201] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 12:59:44 2022] DELETE /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:59:44.417887 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-fbb50056-3eb1-4ce6-939f-de46fa4e1610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:44.418586 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-fbb50056-3eb1-4ce6-939f-de46fa4e1610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:44.424881 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fbb50056-3eb1-4ce6-939f-de46fa4e1610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:44.425467 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fbb50056-3eb1-4ce6-939f-de46fa4e1610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:44.426103 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fbb50056-3eb1-4ce6-939f-de46fa4e1610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:44.426980 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fbb50056-3eb1-4ce6-939f-de46fa4e1610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:44.427577 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fbb50056-3eb1-4ce6-939f-de46fa4e1610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:44.428153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fbb50056-3eb1-4ce6-939f-de46fa4e1610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:44.561963 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-fbb50056-3eb1-4ce6-939f-de46fa4e1610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:44.570141 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-fbb50056-3eb1-4ce6-939f-de46fa4e1610 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1554 microversion: 2.1 time: 0.157056 Sep 15 12:59:44.570716 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 103/202] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:44 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:44.941292 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-91010a38-7e89-45fb-996a-2ed45efd719a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:44.942099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-91010a38-7e89-45fb-996a-2ed45efd719a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:44.949111 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-91010a38-7e89-45fb-996a-2ed45efd719a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:44.949866 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-91010a38-7e89-45fb-996a-2ed45efd719a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:44.950520 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-91010a38-7e89-45fb-996a-2ed45efd719a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:44.951455 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-91010a38-7e89-45fb-996a-2ed45efd719a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:44.952101 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-91010a38-7e89-45fb-996a-2ed45efd719a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:44.952742 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-91010a38-7e89-45fb-996a-2ed45efd719a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:45.136152 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-91010a38-7e89-45fb-996a-2ed45efd719a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:45.138771 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:45.147152 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-91010a38-7e89-45fb-996a-2ed45efd719a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.210518 Sep 15 12:59:45.148340 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 100/203] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:44 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:45.593888 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-657db9db-773d-45b2-b628-7c3fca523bb2 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:45.594770 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-657db9db-773d-45b2-b628-7c3fca523bb2 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:45.602133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-657db9db-773d-45b2-b628-7c3fca523bb2 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:45.603032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-657db9db-773d-45b2-b628-7c3fca523bb2 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:45.603574 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-657db9db-773d-45b2-b628-7c3fca523bb2 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:45.604378 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-657db9db-773d-45b2-b628-7c3fca523bb2 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:45.605064 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-657db9db-773d-45b2-b628-7c3fca523bb2 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:45.605582 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-657db9db-773d-45b2-b628-7c3fca523bb2 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:45.747643 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-657db9db-773d-45b2-b628-7c3fca523bb2 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:45.757844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-657db9db-773d-45b2-b628-7c3fca523bb2 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1554 microversion: 2.1 time: 0.167915 Sep 15 12:59:45.759561 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 104/204] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:45 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:46.171798 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8ce9eb75-0c1e-4d31-8b7a-87ea6d804be7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:46.172573 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8ce9eb75-0c1e-4d31-8b7a-87ea6d804be7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:46.181070 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8ce9eb75-0c1e-4d31-8b7a-87ea6d804be7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:46.182199 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8ce9eb75-0c1e-4d31-8b7a-87ea6d804be7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:46.182809 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8ce9eb75-0c1e-4d31-8b7a-87ea6d804be7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:46.183713 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8ce9eb75-0c1e-4d31-8b7a-87ea6d804be7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:46.184197 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8ce9eb75-0c1e-4d31-8b7a-87ea6d804be7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:46.184652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8ce9eb75-0c1e-4d31-8b7a-87ea6d804be7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:46.374387 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8ce9eb75-0c1e-4d31-8b7a-87ea6d804be7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:46.382428 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8ce9eb75-0c1e-4d31-8b7a-87ea6d804be7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.215110 Sep 15 12:59:46.392458 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 101/205] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:46 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:46.782814 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9a08ad67-66db-45cd-ae14-6ea66ba08ecc tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:46.783992 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9a08ad67-66db-45cd-ae14-6ea66ba08ecc tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:46.791273 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9a08ad67-66db-45cd-ae14-6ea66ba08ecc tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:46.791922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9a08ad67-66db-45cd-ae14-6ea66ba08ecc tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:46.792643 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9a08ad67-66db-45cd-ae14-6ea66ba08ecc tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:46.793520 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9a08ad67-66db-45cd-ae14-6ea66ba08ecc tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:46.794170 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9a08ad67-66db-45cd-ae14-6ea66ba08ecc tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:46.794727 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9a08ad67-66db-45cd-ae14-6ea66ba08ecc tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:46.943841 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9a08ad67-66db-45cd-ae14-6ea66ba08ecc tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:46.956289 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9a08ad67-66db-45cd-ae14-6ea66ba08ecc tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1554 microversion: 2.1 time: 0.177149 Sep 15 12:59:46.956973 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 105/206] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:46 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:47.406203 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-9a1d4a7b-edde-4b9b-8507-d95fe205d266 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:47.406925 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-9a1d4a7b-edde-4b9b-8507-d95fe205d266 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:47.413001 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9a1d4a7b-edde-4b9b-8507-d95fe205d266 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:47.413651 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9a1d4a7b-edde-4b9b-8507-d95fe205d266 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:47.414082 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9a1d4a7b-edde-4b9b-8507-d95fe205d266 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:47.415551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9a1d4a7b-edde-4b9b-8507-d95fe205d266 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:47.416297 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9a1d4a7b-edde-4b9b-8507-d95fe205d266 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:47.416728 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9a1d4a7b-edde-4b9b-8507-d95fe205d266 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:47.574466 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9a1d4a7b-edde-4b9b-8507-d95fe205d266 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:47.582365 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-9a1d4a7b-edde-4b9b-8507-d95fe205d266 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.180016 Sep 15 12:59:47.582929 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 102/207] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:47 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:47.981172 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-81c86ab7-0e75-4a9d-a4c5-461bc290f776 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:47.981774 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-81c86ab7-0e75-4a9d-a4c5-461bc290f776 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:47.988618 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-81c86ab7-0e75-4a9d-a4c5-461bc290f776 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:47.989099 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-81c86ab7-0e75-4a9d-a4c5-461bc290f776 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:47.989703 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-81c86ab7-0e75-4a9d-a4c5-461bc290f776 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:47.990564 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-81c86ab7-0e75-4a9d-a4c5-461bc290f776 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:47.991161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-81c86ab7-0e75-4a9d-a4c5-461bc290f776 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:47.991723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-81c86ab7-0e75-4a9d-a4c5-461bc290f776 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:48.210459 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-81c86ab7-0e75-4a9d-a4c5-461bc290f776 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:48.255837 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-81c86ab7-0e75-4a9d-a4c5-461bc290f776 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1554 microversion: 2.1 time: 0.278662 Sep 15 12:59:48.275517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 106/208] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:47 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1554 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:48.334461 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-9ac202ea-f489-4b05-870f-07861c607ac9 req-084b774c-cf25-4619-a646-b5b977a25aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd7739a-69fe-4204-be18-f21e623d0992", "name": "network-vif-deleted", "tag": "e1b7b694-7f38-474e-8781-153677c9fb5b"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:59:48.344846 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-9ac202ea-f489-4b05-870f-07861c607ac9 req-084b774c-cf25-4619-a646-b5b977a25aba service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:48.345474 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-9ac202ea-f489-4b05-870f-07861c607ac9 req-084b774c-cf25-4619-a646-b5b977a25aba service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:48.346143 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-9ac202ea-f489-4b05-870f-07861c607ac9 req-084b774c-cf25-4619-a646-b5b977a25aba service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:48.362718 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-9ac202ea-f489-4b05-870f-07861c607ac9 req-084b774c-cf25-4619-a646-b5b977a25aba service nova] Creating event network-vif-deleted:e1b7b694-7f38-474e-8781-153677c9fb5b for instance 9fd7739a-69fe-4204-be18-f21e623d0992 on hv-cinder-83608 Sep 15 12:59:48.372750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-9ac202ea-f489-4b05-870f-07861c607ac9 req-084b774c-cf25-4619-a646-b5b977a25aba service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040854 Sep 15 12:59:48.373684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 103/209] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 12:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:59:48.606898 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d22154cb-b5d0-472a-8ff0-0ed144779927 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:48.607533 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d22154cb-b5d0-472a-8ff0-0ed144779927 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:48.613399 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d22154cb-b5d0-472a-8ff0-0ed144779927 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:48.613870 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d22154cb-b5d0-472a-8ff0-0ed144779927 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:48.614298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d22154cb-b5d0-472a-8ff0-0ed144779927 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:48.614962 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d22154cb-b5d0-472a-8ff0-0ed144779927 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:48.615412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d22154cb-b5d0-472a-8ff0-0ed144779927 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:48.615821 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d22154cb-b5d0-472a-8ff0-0ed144779927 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:48.745386 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d22154cb-b5d0-472a-8ff0-0ed144779927 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:48.753024 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d22154cb-b5d0-472a-8ff0-0ed144779927 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.151578 Sep 15 12:59:48.754630 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 107/210] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:48 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:49.284319 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0f124c55-f655-4e03-84e7-d23c8680e69b tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:49.285174 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0f124c55-f655-4e03-84e7-d23c8680e69b tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:49.292603 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f124c55-f655-4e03-84e7-d23c8680e69b tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:49.293095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f124c55-f655-4e03-84e7-d23c8680e69b tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:49.293526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f124c55-f655-4e03-84e7-d23c8680e69b tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:49.294220 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f124c55-f655-4e03-84e7-d23c8680e69b tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:49.294671 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f124c55-f655-4e03-84e7-d23c8680e69b tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:49.295242 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f124c55-f655-4e03-84e7-d23c8680e69b tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:49.359560 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0f124c55-f655-4e03-84e7-d23c8680e69b tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:49.367679 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0f124c55-f655-4e03-84e7-d23c8680e69b tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1346 microversion: 2.1 time: 0.088036 Sep 15 12:59:49.368414 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 104/211] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:49 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:49.778503 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-27545c2b-2fe8-4cec-bd32-5d83ce6584cc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:49.779673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-27545c2b-2fe8-4cec-bd32-5d83ce6584cc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:49.786259 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-27545c2b-2fe8-4cec-bd32-5d83ce6584cc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:49.786783 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-27545c2b-2fe8-4cec-bd32-5d83ce6584cc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:49.787239 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-27545c2b-2fe8-4cec-bd32-5d83ce6584cc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:49.787928 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-27545c2b-2fe8-4cec-bd32-5d83ce6584cc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:49.788409 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-27545c2b-2fe8-4cec-bd32-5d83ce6584cc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:49.788822 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-27545c2b-2fe8-4cec-bd32-5d83ce6584cc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:49.928177 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-27545c2b-2fe8-4cec-bd32-5d83ce6584cc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:49.940121 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-27545c2b-2fe8-4cec-bd32-5d83ce6584cc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.165808 Sep 15 12:59:49.940738 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 108/212] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:49 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:50.389859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-709281bf-ed19-458f-a4e7-abc85714bb05 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:50.390471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-709281bf-ed19-458f-a4e7-abc85714bb05 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:50.396710 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-709281bf-ed19-458f-a4e7-abc85714bb05 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:50.397195 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-709281bf-ed19-458f-a4e7-abc85714bb05 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:50.397867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-709281bf-ed19-458f-a4e7-abc85714bb05 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:50.398560 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-709281bf-ed19-458f-a4e7-abc85714bb05 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:50.399044 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-709281bf-ed19-458f-a4e7-abc85714bb05 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:50.399580 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-709281bf-ed19-458f-a4e7-abc85714bb05 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:50.431974 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-709281bf-ed19-458f-a4e7-abc85714bb05 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:50.432491 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-709281bf-ed19-458f-a4e7-abc85714bb05 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:50.432930 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-709281bf-ed19-458f-a4e7-abc85714bb05 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:50.433378 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-709281bf-ed19-458f-a4e7-abc85714bb05 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lazy-loading 'fault' on Instance uuid 9fd7739a-69fe-4204-be18-f21e623d0992 {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:59:50.503313 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-709281bf-ed19-458f-a4e7-abc85714bb05 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082e5aa56ac147e6a8f8c797b269ff23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2cd7163bd9476891dfe836246ead22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:50.511872 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-709281bf-ed19-458f-a4e7-abc85714bb05 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 200 len: 1351 microversion: 2.1 time: 0.125777 Sep 15 12:59:50.512564 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 105/213] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:50 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 1351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:50.967634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-eb7b4106-85ff-4e97-a181-f50f3da9d4c7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:50.968248 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-eb7b4106-85ff-4e97-a181-f50f3da9d4c7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:50.975053 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eb7b4106-85ff-4e97-a181-f50f3da9d4c7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:50.975544 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eb7b4106-85ff-4e97-a181-f50f3da9d4c7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:50.975980 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eb7b4106-85ff-4e97-a181-f50f3da9d4c7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:50.977679 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eb7b4106-85ff-4e97-a181-f50f3da9d4c7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:50.978307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eb7b4106-85ff-4e97-a181-f50f3da9d4c7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:50.978737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eb7b4106-85ff-4e97-a181-f50f3da9d4c7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:51.115502 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-eb7b4106-85ff-4e97-a181-f50f3da9d4c7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:51.119330 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=100 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:51.124942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-eb7b4106-85ff-4e97-a181-f50f3da9d4c7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.161185 Sep 15 12:59:51.125514 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 109/214] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:50 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:51.535420 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0cd2f1b4-3271-431c-a2c0-e6f60e0ee20f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:51.536069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0cd2f1b4-3271-431c-a2c0-e6f60e0ee20f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:51.542346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0cd2f1b4-3271-431c-a2c0-e6f60e0ee20f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:51.542831 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0cd2f1b4-3271-431c-a2c0-e6f60e0ee20f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:51.543266 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0cd2f1b4-3271-431c-a2c0-e6f60e0ee20f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:51.543957 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0cd2f1b4-3271-431c-a2c0-e6f60e0ee20f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:51.544453 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0cd2f1b4-3271-431c-a2c0-e6f60e0ee20f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:51.544879 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0cd2f1b4-3271-431c-a2c0-e6f60e0ee20f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:51.559444 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-0cd2f1b4-3271-431c-a2c0-e6f60e0ee20f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] HTTP exception thrown: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0cd2f1b4-3271-431c-a2c0-e6f60e0ee20f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Request method failure captured: Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 HTTP/1.1 Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyGChpBDazz9TycN7_JFplbDNyKkEGzRIuKCwOldc95cvImRgzwrLhL-8IG6cHLXiN4lxcm87ZDhFQXBezZL338y2ybFCdptVsL6yqTN-x61SjoEzUwUFtb1U8lCQImcn7y_4fuJMoFGmMuJn9e40mVvz0DB_mtEBtpX_1dwLPHacAs Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: dc2cd7163bd9476891dfe836246ead22 Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-DeleteServersTestJSON-1908783272 Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 12:59:51.564347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 12:59:51.565816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dc2cd7163bd9476891dfe836246ead22", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dc2cd7163bd9476891dfe836246ead22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dc2cd7163bd9476891dfe836246ead22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dc2cd7163bd9476891dfe836246ead22"}]}] Sep 15 12:59:51.565816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-DeleteServersTestJSON-1908783272 Sep 15 12:59:51.565816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: dc2cd7163bd9476891dfe836246ead22 Sep 15 12:59:51.565816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-DeleteServersTestJSON-1908783272 Sep 15 12:59:51.565816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-DeleteServersTestJSON-1908783272-project Sep 15 12:59:51.565816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 12:59:51.565816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 12:59:51.565816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: 082e5aa56ac147e6a8f8c797b269ff23 Sep 15 12:59:51.565816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-DeleteServersTestJSON-1908783272-project Sep 15 12:59:51.565816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 12:59:51.565816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:51.565816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': '9fd7739a-69fe-4204-be18-f21e623d0992'} Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:59:51.566604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:51.567797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 12:59:51.568911 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0cd2f1b4-3271-431c-a2c0-e6f60e0ee20f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Returning 404 to user: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:59:51.568911 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0cd2f1b4-3271-431c-a2c0-e6f60e0ee20f tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 404 len: 111 microversion: 2.1 time: 0.034199 Sep 15 12:59:51.568911 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 106/215] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:51 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:59:51.684488 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a0c1575d-cd1c-463f-9c44-227489ecd835 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:51.686675 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a0c1575d-cd1c-463f-9c44-227489ecd835 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:51.693378 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a0c1575d-cd1c-463f-9c44-227489ecd835 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:51.693868 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a0c1575d-cd1c-463f-9c44-227489ecd835 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:51.694298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a0c1575d-cd1c-463f-9c44-227489ecd835 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:51.694992 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a0c1575d-cd1c-463f-9c44-227489ecd835 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:51.695441 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a0c1575d-cd1c-463f-9c44-227489ecd835 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:51.696443 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a0c1575d-cd1c-463f-9c44-227489ecd835 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:51.710488 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-a0c1575d-cd1c-463f-9c44-227489ecd835 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] HTTP exception thrown: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a0c1575d-cd1c-463f-9c44-227489ecd835 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Request method failure captured: Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992/os-volume_attachments HTTP/1.1 Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyGChpBDazz9TycN7_JFplbDNyKkEGzRIuKCwOldc95cvImRgzwrLhL-8IG6cHLXiN4lxcm87ZDhFQXBezZL338y2ybFCdptVsL6yqTN-x61SjoEzUwUFtb1U8lCQImcn7y_4fuJMoFGmMuJn9e40mVvz0DB_mtEBtpX_1dwLPHacAs Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: dc2cd7163bd9476891dfe836246ead22 Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-DeleteServersTestJSON-1908783272 Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 12:59:51.714796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 12:59:51.715996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dc2cd7163bd9476891dfe836246ead22", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dc2cd7163bd9476891dfe836246ead22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dc2cd7163bd9476891dfe836246ead22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dc2cd7163bd9476891dfe836246ead22"}]}] Sep 15 12:59:51.715996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-DeleteServersTestJSON-1908783272 Sep 15 12:59:51.715996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: dc2cd7163bd9476891dfe836246ead22 Sep 15 12:59:51.715996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-DeleteServersTestJSON-1908783272 Sep 15 12:59:51.715996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-DeleteServersTestJSON-1908783272-project Sep 15 12:59:51.715996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 12:59:51.715996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 12:59:51.715996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 082e5aa56ac147e6a8f8c797b269ff23 Sep 15 12:59:51.715996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-DeleteServersTestJSON-1908783272-project Sep 15 12:59:51.715996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 12:59:51.715996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:51.715996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'server_id': '9fd7739a-69fe-4204-be18-f21e623d0992'} Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:59:51.716839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:51.717896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:51.719089 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a0c1575d-cd1c-463f-9c44-227489ecd835 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Returning 404 to user: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:59:51.719089 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a0c1575d-cd1c-463f-9c44-227489ecd835 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036722 Sep 15 12:59:51.719089 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 110/216] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 12:59:51 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:59:52.148939 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1fa3b7e8-842a-4fbd-a5ec-23af956e18d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:52.149554 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1fa3b7e8-842a-4fbd-a5ec-23af956e18d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:52.155698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1fa3b7e8-842a-4fbd-a5ec-23af956e18d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:52.156178 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1fa3b7e8-842a-4fbd-a5ec-23af956e18d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:52.156649 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1fa3b7e8-842a-4fbd-a5ec-23af956e18d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:52.157340 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1fa3b7e8-842a-4fbd-a5ec-23af956e18d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:52.157790 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1fa3b7e8-842a-4fbd-a5ec-23af956e18d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:52.158213 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1fa3b7e8-842a-4fbd-a5ec-23af956e18d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:52.291705 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1fa3b7e8-842a-4fbd-a5ec-23af956e18d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:52.299390 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1fa3b7e8-842a-4fbd-a5ec-23af956e18d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.154460 Sep 15 12:59:52.299957 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 107/217] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:52 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:53.323396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9e529a1b-ee14-4d30-a860-33518aa7a47e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:53.324034 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9e529a1b-ee14-4d30-a860-33518aa7a47e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:53.330432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9e529a1b-ee14-4d30-a860-33518aa7a47e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:53.330910 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9e529a1b-ee14-4d30-a860-33518aa7a47e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:53.331344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9e529a1b-ee14-4d30-a860-33518aa7a47e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:53.332028 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9e529a1b-ee14-4d30-a860-33518aa7a47e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:53.332502 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9e529a1b-ee14-4d30-a860-33518aa7a47e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:53.332925 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9e529a1b-ee14-4d30-a860-33518aa7a47e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:53.461821 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9e529a1b-ee14-4d30-a860-33518aa7a47e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:53.470067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9e529a1b-ee14-4d30-a860-33518aa7a47e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.151324 Sep 15 12:59:53.470628 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 111/218] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:53 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:54.492577 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-77b15ea1-7e54-4249-8b75-6bcd08550308 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:54.493181 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-77b15ea1-7e54-4249-8b75-6bcd08550308 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:54.495259 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:54.500566 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-77b15ea1-7e54-4249-8b75-6bcd08550308 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:54.501049 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-77b15ea1-7e54-4249-8b75-6bcd08550308 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:54.501484 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-77b15ea1-7e54-4249-8b75-6bcd08550308 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:54.502168 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-77b15ea1-7e54-4249-8b75-6bcd08550308 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:54.502624 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-77b15ea1-7e54-4249-8b75-6bcd08550308 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:54.503044 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-77b15ea1-7e54-4249-8b75-6bcd08550308 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:54.631295 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-77b15ea1-7e54-4249-8b75-6bcd08550308 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:54.639042 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-77b15ea1-7e54-4249-8b75-6bcd08550308 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.150292 Sep 15 12:59:54.639607 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 108/219] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:54 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:55.662942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-dfa947da-f722-47cb-ac1c-3ea7dd4b6255 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:55.663546 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-dfa947da-f722-47cb-ac1c-3ea7dd4b6255 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:55.669909 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dfa947da-f722-47cb-ac1c-3ea7dd4b6255 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:55.670392 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dfa947da-f722-47cb-ac1c-3ea7dd4b6255 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:55.670829 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dfa947da-f722-47cb-ac1c-3ea7dd4b6255 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:55.671517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dfa947da-f722-47cb-ac1c-3ea7dd4b6255 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:55.671995 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dfa947da-f722-47cb-ac1c-3ea7dd4b6255 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:55.672445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dfa947da-f722-47cb-ac1c-3ea7dd4b6255 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:55.802852 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-dfa947da-f722-47cb-ac1c-3ea7dd4b6255 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:55.811557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-dfa947da-f722-47cb-ac1c-3ea7dd4b6255 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.152422 Sep 15 12:59:55.812077 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 112/220] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:55 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:56.835196 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-dfed1d76-a50d-464e-93be-b5be95a5d42b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:56.836265 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-dfed1d76-a50d-464e-93be-b5be95a5d42b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:56.842674 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dfed1d76-a50d-464e-93be-b5be95a5d42b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:56.843144 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dfed1d76-a50d-464e-93be-b5be95a5d42b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:56.843569 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dfed1d76-a50d-464e-93be-b5be95a5d42b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:56.844253 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dfed1d76-a50d-464e-93be-b5be95a5d42b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:56.844725 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dfed1d76-a50d-464e-93be-b5be95a5d42b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:56.845142 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dfed1d76-a50d-464e-93be-b5be95a5d42b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:56.972303 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-dfed1d76-a50d-464e-93be-b5be95a5d42b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:56.979942 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-dfed1d76-a50d-464e-93be-b5be95a5d42b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.149060 Sep 15 12:59:56.980520 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 109/221] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:56 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:58.003011 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9111d97a-1e8a-408a-8069-a72ffd3a2b6a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:58.003549 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9111d97a-1e8a-408a-8069-a72ffd3a2b6a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:58.010456 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9111d97a-1e8a-408a-8069-a72ffd3a2b6a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:58.010933 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9111d97a-1e8a-408a-8069-a72ffd3a2b6a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:58.011364 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9111d97a-1e8a-408a-8069-a72ffd3a2b6a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:58.012052 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9111d97a-1e8a-408a-8069-a72ffd3a2b6a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:58.012525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9111d97a-1e8a-408a-8069-a72ffd3a2b6a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:58.012948 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9111d97a-1e8a-408a-8069-a72ffd3a2b6a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:58.146994 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9111d97a-1e8a-408a-8069-a72ffd3a2b6a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:58.154982 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9111d97a-1e8a-408a-8069-a72ffd3a2b6a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.155911 Sep 15 12:59:58.155550 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 113/222] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:57 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:59.178248 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4a1eabb4-69b7-4239-b238-d2c34a506675 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:59.178858 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-4a1eabb4-69b7-4239-b238-d2c34a506675 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:59.185356 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a1eabb4-69b7-4239-b238-d2c34a506675 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:59.185833 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a1eabb4-69b7-4239-b238-d2c34a506675 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:59.186266 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a1eabb4-69b7-4239-b238-d2c34a506675 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:59.186940 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a1eabb4-69b7-4239-b238-d2c34a506675 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:59.187387 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a1eabb4-69b7-4239-b238-d2c34a506675 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:59.187802 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a1eabb4-69b7-4239-b238-d2c34a506675 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:59.280648 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-1a1c1c9e-79ee-4939-8e63-d55f68e5eb3a tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:59.281056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-1a1c1c9e-79ee-4939-8e63-d55f68e5eb3a tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:59.287675 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1a1c1c9e-79ee-4939-8e63-d55f68e5eb3a tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:59.288164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1a1c1c9e-79ee-4939-8e63-d55f68e5eb3a tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:59.288634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1a1c1c9e-79ee-4939-8e63-d55f68e5eb3a tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:59.289336 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1a1c1c9e-79ee-4939-8e63-d55f68e5eb3a tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:59.289788 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1a1c1c9e-79ee-4939-8e63-d55f68e5eb3a tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:59.290210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1a1c1c9e-79ee-4939-8e63-d55f68e5eb3a tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:59.304406 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-1a1c1c9e-79ee-4939-8e63-d55f68e5eb3a tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] HTTP exception thrown: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-1a1c1c9e-79ee-4939-8e63-d55f68e5eb3a tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Request method failure captured: Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: DELETE /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 HTTP/1.1 Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyGChpBDazz9TycN7_JFplbDNyKkEGzRIuKCwOldc95cvImRgzwrLhL-8IG6cHLXiN4lxcm87ZDhFQXBezZL338y2ybFCdptVsL6yqTN-x61SjoEzUwUFtb1U8lCQImcn7y_4fuJMoFGmMuJn9e40mVvz0DB_mtEBtpX_1dwLPHacAs Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: dc2cd7163bd9476891dfe836246ead22 Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-DeleteServersTestJSON-1908783272 Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 12:59:59.307212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 12:59:59.308440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dc2cd7163bd9476891dfe836246ead22", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dc2cd7163bd9476891dfe836246ead22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dc2cd7163bd9476891dfe836246ead22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dc2cd7163bd9476891dfe836246ead22"}]}] Sep 15 12:59:59.308440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-DeleteServersTestJSON-1908783272 Sep 15 12:59:59.308440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: dc2cd7163bd9476891dfe836246ead22 Sep 15 12:59:59.308440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-DeleteServersTestJSON-1908783272 Sep 15 12:59:59.308440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-DeleteServersTestJSON-1908783272-project Sep 15 12:59:59.308440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 12:59:59.308440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 12:59:59.308440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 082e5aa56ac147e6a8f8c797b269ff23 Sep 15 12:59:59.308440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-DeleteServersTestJSON-1908783272-project Sep 15 12:59:59.308440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 12:59:59.308440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:59.308440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '9fd7739a-69fe-4204-be18-f21e623d0992'} Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:59:59.309091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:59.310957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:59.312557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-1a1c1c9e-79ee-4939-8e63-d55f68e5eb3a tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Returning 404 to user: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:59:59.312557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-1a1c1c9e-79ee-4939-8e63-d55f68e5eb3a tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 404 len: 111 microversion: 2.1 time: 0.032098 Sep 15 12:59:59.312557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 114/223] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 12:59:59 2022] DELETE /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 12:59:59.315807 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-4a1eabb4-69b7-4239-b238-d2c34a506675 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:59:59.316876 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-70bb6489-a650-4479-ba69-6620cd57c365 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:59:59.317487 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-70bb6489-a650-4479-ba69-6620cd57c365 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] [instance: 9fd7739a-69fe-4204-be18-f21e623d0992] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:59:59.323761 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-70bb6489-a650-4479-ba69-6620cd57c365 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:59.324243 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-70bb6489-a650-4479-ba69-6620cd57c365 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:59.324705 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-70bb6489-a650-4479-ba69-6620cd57c365 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:59.324824 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-4a1eabb4-69b7-4239-b238-d2c34a506675 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.150381 Sep 15 12:59:59.325329 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 110/224] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:59 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:59:59.325421 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-70bb6489-a650-4479-ba69-6620cd57c365 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:59:59.325837 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-70bb6489-a650-4479-ba69-6620cd57c365 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:59:59.326258 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-70bb6489-a650-4479-ba69-6620cd57c365 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:59:59.339736 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-70bb6489-a650-4479-ba69-6620cd57c365 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] HTTP exception thrown: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-70bb6489-a650-4479-ba69-6620cd57c365 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Request method failure captured: Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 HTTP/1.1 Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyGChpBDazz9TycN7_JFplbDNyKkEGzRIuKCwOldc95cvImRgzwrLhL-8IG6cHLXiN4lxcm87ZDhFQXBezZL338y2ybFCdptVsL6yqTN-x61SjoEzUwUFtb1U8lCQImcn7y_4fuJMoFGmMuJn9e40mVvz0DB_mtEBtpX_1dwLPHacAs Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: dc2cd7163bd9476891dfe836246ead22 Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-DeleteServersTestJSON-1908783272 Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 12:59:59.341298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 12:59:59.342698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dc2cd7163bd9476891dfe836246ead22", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dc2cd7163bd9476891dfe836246ead22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dc2cd7163bd9476891dfe836246ead22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dc2cd7163bd9476891dfe836246ead22"}]}] Sep 15 12:59:59.342698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-DeleteServersTestJSON-1908783272 Sep 15 12:59:59.342698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: dc2cd7163bd9476891dfe836246ead22 Sep 15 12:59:59.342698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-DeleteServersTestJSON-1908783272 Sep 15 12:59:59.342698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-DeleteServersTestJSON-1908783272-project Sep 15 12:59:59.342698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 12:59:59.342698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 12:59:59.342698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 082e5aa56ac147e6a8f8c797b269ff23 Sep 15 12:59:59.342698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-DeleteServersTestJSON-1908783272-project Sep 15 12:59:59.342698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 12:59:59.342698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:59.342698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '9fd7739a-69fe-4204-be18-f21e623d0992'} Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:59:59.343387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. Sep 15 12:59:59.344445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 12:59:59.345389 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-70bb6489-a650-4479-ba69-6620cd57c365 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] Returning 404 to user: Instance 9fd7739a-69fe-4204-be18-f21e623d0992 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:59:59.345389 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-70bb6489-a650-4479-ba69-6620cd57c365 tempest-DeleteServersTestJSON-1908783272 tempest-DeleteServersTestJSON-1908783272-project] 10.222.0.57 "GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992" status: 404 len: 111 microversion: 2.1 time: 0.031063 Sep 15 12:59:59.345786 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 115/225] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 12:59:59 2022] GET /compute/v2.1/servers/9fd7739a-69fe-4204-be18-f21e623d0992 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 13:00:00.347795 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-7e67f9ca-8a52-456c-a602-e1517fc1eea5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:00.348457 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-7e67f9ca-8a52-456c-a602-e1517fc1eea5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:00.354418 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7e67f9ca-8a52-456c-a602-e1517fc1eea5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:00.354936 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7e67f9ca-8a52-456c-a602-e1517fc1eea5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:00.355370 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7e67f9ca-8a52-456c-a602-e1517fc1eea5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:00.356092 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7e67f9ca-8a52-456c-a602-e1517fc1eea5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:00.356572 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7e67f9ca-8a52-456c-a602-e1517fc1eea5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:00.356995 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7e67f9ca-8a52-456c-a602-e1517fc1eea5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:00.549181 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-7e67f9ca-8a52-456c-a602-e1517fc1eea5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:00.558446 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-7e67f9ca-8a52-456c-a602-e1517fc1eea5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.214492 Sep 15 13:00:00.559030 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 111/226] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:00 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:01.585022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c69f3d83-d85e-44db-b5b2-be1c7886a606 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:01.585628 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c69f3d83-d85e-44db-b5b2-be1c7886a606 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:01.592814 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c69f3d83-d85e-44db-b5b2-be1c7886a606 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:01.593294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c69f3d83-d85e-44db-b5b2-be1c7886a606 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:01.593723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c69f3d83-d85e-44db-b5b2-be1c7886a606 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:01.594412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c69f3d83-d85e-44db-b5b2-be1c7886a606 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:01.594854 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c69f3d83-d85e-44db-b5b2-be1c7886a606 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:01.595269 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c69f3d83-d85e-44db-b5b2-be1c7886a606 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:01.733809 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c69f3d83-d85e-44db-b5b2-be1c7886a606 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:01.741434 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c69f3d83-d85e-44db-b5b2-be1c7886a606 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.160292 Sep 15 13:00:01.741991 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 116/227] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:01 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:02.765024 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d9a5da76-f5bc-49dd-8a0c-16d8d18fda72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:02.765633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d9a5da76-f5bc-49dd-8a0c-16d8d18fda72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:02.771862 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d9a5da76-f5bc-49dd-8a0c-16d8d18fda72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:02.772376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d9a5da76-f5bc-49dd-8a0c-16d8d18fda72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:02.772816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d9a5da76-f5bc-49dd-8a0c-16d8d18fda72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:02.773509 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d9a5da76-f5bc-49dd-8a0c-16d8d18fda72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:02.773962 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d9a5da76-f5bc-49dd-8a0c-16d8d18fda72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:02.774384 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d9a5da76-f5bc-49dd-8a0c-16d8d18fda72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:02.906152 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d9a5da76-f5bc-49dd-8a0c-16d8d18fda72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:02.913964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d9a5da76-f5bc-49dd-8a0c-16d8d18fda72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.152730 Sep 15 13:00:02.914536 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 112/228] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:02 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:03.937716 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-feac6cf9-919a-4098-b0a9-020447c03125 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:03.938331 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-feac6cf9-919a-4098-b0a9-020447c03125 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:03.944772 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-feac6cf9-919a-4098-b0a9-020447c03125 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:03.945255 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-feac6cf9-919a-4098-b0a9-020447c03125 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:03.945687 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-feac6cf9-919a-4098-b0a9-020447c03125 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:03.946887 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-feac6cf9-919a-4098-b0a9-020447c03125 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:03.947384 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-feac6cf9-919a-4098-b0a9-020447c03125 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:03.947901 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-feac6cf9-919a-4098-b0a9-020447c03125 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:04.087184 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-feac6cf9-919a-4098-b0a9-020447c03125 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:04.095438 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-feac6cf9-919a-4098-b0a9-020447c03125 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.161506 Sep 15 13:00:04.095999 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 117/229] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:03 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:05.119603 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f5875c10-7cdd-4b84-bfc8-2c8a6c532660 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:05.120214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f5875c10-7cdd-4b84-bfc8-2c8a6c532660 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:05.126125 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5875c10-7cdd-4b84-bfc8-2c8a6c532660 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:05.126659 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5875c10-7cdd-4b84-bfc8-2c8a6c532660 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:05.127095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5875c10-7cdd-4b84-bfc8-2c8a6c532660 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:05.127783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5875c10-7cdd-4b84-bfc8-2c8a6c532660 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:05.128230 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5875c10-7cdd-4b84-bfc8-2c8a6c532660 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:05.128684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5875c10-7cdd-4b84-bfc8-2c8a6c532660 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:05.279732 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f5875c10-7cdd-4b84-bfc8-2c8a6c532660 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:05.287682 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f5875c10-7cdd-4b84-bfc8-2c8a6c532660 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.172656 Sep 15 13:00:05.288249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 113/230] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:05 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:06.315825 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0bd21b34-303b-4f26-926c-8091cccee01c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:06.316461 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0bd21b34-303b-4f26-926c-8091cccee01c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:06.318847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=45 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:06.332368 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0bd21b34-303b-4f26-926c-8091cccee01c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:06.332867 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0bd21b34-303b-4f26-926c-8091cccee01c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:06.340639 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0bd21b34-303b-4f26-926c-8091cccee01c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:06.341395 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0bd21b34-303b-4f26-926c-8091cccee01c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:06.341861 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0bd21b34-303b-4f26-926c-8091cccee01c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:06.342287 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0bd21b34-303b-4f26-926c-8091cccee01c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:06.483961 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0bd21b34-303b-4f26-926c-8091cccee01c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:06.491671 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0bd21b34-303b-4f26-926c-8091cccee01c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.183473 Sep 15 13:00:06.492242 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 118/231] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:06 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:07.515582 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f62e0be5-b731-49e0-9606-2cd7f59e2fd7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:07.516303 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f62e0be5-b731-49e0-9606-2cd7f59e2fd7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:07.522729 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f62e0be5-b731-49e0-9606-2cd7f59e2fd7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:07.523215 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f62e0be5-b731-49e0-9606-2cd7f59e2fd7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:07.523659 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f62e0be5-b731-49e0-9606-2cd7f59e2fd7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:07.524383 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f62e0be5-b731-49e0-9606-2cd7f59e2fd7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:07.524848 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f62e0be5-b731-49e0-9606-2cd7f59e2fd7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:07.525270 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f62e0be5-b731-49e0-9606-2cd7f59e2fd7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:07.654918 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f62e0be5-b731-49e0-9606-2cd7f59e2fd7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:07.662573 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f62e0be5-b731-49e0-9606-2cd7f59e2fd7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.150888 Sep 15 13:00:07.663142 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 114/232] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:07 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:08.686362 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-6e43e7af-b92d-4403-9371-713628161388 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:08.686890 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-6e43e7af-b92d-4403-9371-713628161388 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:08.693265 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6e43e7af-b92d-4403-9371-713628161388 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:08.693747 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6e43e7af-b92d-4403-9371-713628161388 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:08.694177 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6e43e7af-b92d-4403-9371-713628161388 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:08.694894 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6e43e7af-b92d-4403-9371-713628161388 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:08.695344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6e43e7af-b92d-4403-9371-713628161388 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:08.695767 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6e43e7af-b92d-4403-9371-713628161388 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:08.823348 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-6e43e7af-b92d-4403-9371-713628161388 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:08.830949 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-6e43e7af-b92d-4403-9371-713628161388 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.148500 Sep 15 13:00:08.831509 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 119/233] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:08 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:09.853467 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e776264a-b1b6-448d-913e-1bea70046296 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:09.854077 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-e776264a-b1b6-448d-913e-1bea70046296 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:09.860017 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e776264a-b1b6-448d-913e-1bea70046296 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:09.860529 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e776264a-b1b6-448d-913e-1bea70046296 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:09.860964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e776264a-b1b6-448d-913e-1bea70046296 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:09.861651 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e776264a-b1b6-448d-913e-1bea70046296 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:09.862095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e776264a-b1b6-448d-913e-1bea70046296 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:09.862515 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e776264a-b1b6-448d-913e-1bea70046296 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:09.997433 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e776264a-b1b6-448d-913e-1bea70046296 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:10.005138 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e776264a-b1b6-448d-913e-1bea70046296 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.155521 Sep 15 13:00:10.005696 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 115/234] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:09 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:00:11.028942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0bbb6f7b-3c7f-4584-a3f0-e7deff50a3d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:11.029550 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0bbb6f7b-3c7f-4584-a3f0-e7deff50a3d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:11.036069 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f7b-3c7f-4584-a3f0-e7deff50a3d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:11.036584 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f7b-3c7f-4584-a3f0-e7deff50a3d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:11.037020 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f7b-3c7f-4584-a3f0-e7deff50a3d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:11.037708 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f7b-3c7f-4584-a3f0-e7deff50a3d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:11.038161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f7b-3c7f-4584-a3f0-e7deff50a3d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:11.038580 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f7b-3c7f-4584-a3f0-e7deff50a3d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:11.170645 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0bbb6f7b-3c7f-4584-a3f0-e7deff50a3d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:11.178667 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0bbb6f7b-3c7f-4584-a3f0-e7deff50a3d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.153683 Sep 15 13:00:11.179227 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 120/235] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:11 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:12.206759 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-beec690d-0235-485e-847a-4c9cedbf9289 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:12.207435 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-beec690d-0235-485e-847a-4c9cedbf9289 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:12.215261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-beec690d-0235-485e-847a-4c9cedbf9289 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:12.215753 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-beec690d-0235-485e-847a-4c9cedbf9289 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:12.216194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-beec690d-0235-485e-847a-4c9cedbf9289 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:12.216935 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-beec690d-0235-485e-847a-4c9cedbf9289 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:12.217388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-beec690d-0235-485e-847a-4c9cedbf9289 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:12.217812 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-beec690d-0235-485e-847a-4c9cedbf9289 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:12.362711 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-beec690d-0235-485e-847a-4c9cedbf9289 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:12.373125 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-beec690d-0235-485e-847a-4c9cedbf9289 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.168432 Sep 15 13:00:12.374146 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 116/236] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:12 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:13.398342 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0cb1891e-62fb-419b-bfc2-93a3ae5d1bdb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:13.399495 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0cb1891e-62fb-419b-bfc2-93a3ae5d1bdb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:13.409389 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0cb1891e-62fb-419b-bfc2-93a3ae5d1bdb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:13.410398 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0cb1891e-62fb-419b-bfc2-93a3ae5d1bdb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:13.411008 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0cb1891e-62fb-419b-bfc2-93a3ae5d1bdb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:13.411934 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0cb1891e-62fb-419b-bfc2-93a3ae5d1bdb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:13.412905 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0cb1891e-62fb-419b-bfc2-93a3ae5d1bdb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:13.414551 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0cb1891e-62fb-419b-bfc2-93a3ae5d1bdb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:13.556057 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0cb1891e-62fb-419b-bfc2-93a3ae5d1bdb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:13.564544 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0cb1891e-62fb-419b-bfc2-93a3ae5d1bdb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.170391 Sep 15 13:00:13.565195 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 121/237] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:13 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:14.587964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2c540d21-4e19-47a6-9a3f-d3bfa00e5a7d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:14.588681 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2c540d21-4e19-47a6-9a3f-d3bfa00e5a7d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:14.594492 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2c540d21-4e19-47a6-9a3f-d3bfa00e5a7d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:14.595073 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2c540d21-4e19-47a6-9a3f-d3bfa00e5a7d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:14.595507 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2c540d21-4e19-47a6-9a3f-d3bfa00e5a7d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:14.596188 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2c540d21-4e19-47a6-9a3f-d3bfa00e5a7d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:14.596664 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2c540d21-4e19-47a6-9a3f-d3bfa00e5a7d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:14.597080 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2c540d21-4e19-47a6-9a3f-d3bfa00e5a7d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:14.730393 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2c540d21-4e19-47a6-9a3f-d3bfa00e5a7d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:14.738714 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2c540d21-4e19-47a6-9a3f-d3bfa00e5a7d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.155077 Sep 15 13:00:14.740308 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 117/238] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:14 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:15.762565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2d05fea6-8072-4233-8423-2aaaa47c031d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:15.763083 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2d05fea6-8072-4233-8423-2aaaa47c031d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:15.769676 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2d05fea6-8072-4233-8423-2aaaa47c031d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:15.770153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2d05fea6-8072-4233-8423-2aaaa47c031d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:15.770580 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2d05fea6-8072-4233-8423-2aaaa47c031d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:15.771258 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2d05fea6-8072-4233-8423-2aaaa47c031d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:15.771704 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2d05fea6-8072-4233-8423-2aaaa47c031d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:15.772153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2d05fea6-8072-4233-8423-2aaaa47c031d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:15.905197 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2d05fea6-8072-4233-8423-2aaaa47c031d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:15.912733 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2d05fea6-8072-4233-8423-2aaaa47c031d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.154646 Sep 15 13:00:15.913298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 122/239] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:15 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:16.935656 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-cde121fe-7c32-43ed-94bc-f8b29ab34c9a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:16.936290 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-cde121fe-7c32-43ed-94bc-f8b29ab34c9a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:16.942600 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cde121fe-7c32-43ed-94bc-f8b29ab34c9a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:16.943080 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cde121fe-7c32-43ed-94bc-f8b29ab34c9a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:16.943512 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cde121fe-7c32-43ed-94bc-f8b29ab34c9a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:16.944196 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cde121fe-7c32-43ed-94bc-f8b29ab34c9a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:16.944682 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cde121fe-7c32-43ed-94bc-f8b29ab34c9a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:16.945103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cde121fe-7c32-43ed-94bc-f8b29ab34c9a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:16.949774 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=98 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:17.072946 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-cde121fe-7c32-43ed-94bc-f8b29ab34c9a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:17.081643 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-cde121fe-7c32-43ed-94bc-f8b29ab34c9a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.149656 Sep 15 13:00:17.082479 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 118/240] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:16 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:18.104220 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bfdaeca5-9dca-461e-875d-d610c818bd2c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:18.104848 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-bfdaeca5-9dca-461e-875d-d610c818bd2c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:18.111096 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bfdaeca5-9dca-461e-875d-d610c818bd2c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:18.111576 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bfdaeca5-9dca-461e-875d-d610c818bd2c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:18.112006 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bfdaeca5-9dca-461e-875d-d610c818bd2c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:18.112715 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bfdaeca5-9dca-461e-875d-d610c818bd2c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:18.113168 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bfdaeca5-9dca-461e-875d-d610c818bd2c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:18.113590 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bfdaeca5-9dca-461e-875d-d610c818bd2c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:18.238868 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-bfdaeca5-9dca-461e-875d-d610c818bd2c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:18.247153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-bfdaeca5-9dca-461e-875d-d610c818bd2c tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.146836 Sep 15 13:00:18.247717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 123/241] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:18 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:19.270317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6090b721-2627-4b0e-9994-4f97e02a0f2d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:19.270961 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6090b721-2627-4b0e-9994-4f97e02a0f2d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:19.277627 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6090b721-2627-4b0e-9994-4f97e02a0f2d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:19.278111 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6090b721-2627-4b0e-9994-4f97e02a0f2d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:19.278547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6090b721-2627-4b0e-9994-4f97e02a0f2d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:19.279235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6090b721-2627-4b0e-9994-4f97e02a0f2d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:19.279684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6090b721-2627-4b0e-9994-4f97e02a0f2d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:19.280103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6090b721-2627-4b0e-9994-4f97e02a0f2d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:19.409367 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6090b721-2627-4b0e-9994-4f97e02a0f2d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:19.417520 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6090b721-2627-4b0e-9994-4f97e02a0f2d tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.151283 Sep 15 13:00:19.418119 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 119/242] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:19 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:20.440640 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8525ae77-9657-4882-91d1-b99fc312b951 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:20.441255 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-8525ae77-9657-4882-91d1-b99fc312b951 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:20.447792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8525ae77-9657-4882-91d1-b99fc312b951 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:20.448291 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8525ae77-9657-4882-91d1-b99fc312b951 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:20.448741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8525ae77-9657-4882-91d1-b99fc312b951 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:20.449429 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8525ae77-9657-4882-91d1-b99fc312b951 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:20.449887 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8525ae77-9657-4882-91d1-b99fc312b951 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:20.450305 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8525ae77-9657-4882-91d1-b99fc312b951 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:20.578070 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-8525ae77-9657-4882-91d1-b99fc312b951 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:20.585732 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8525ae77-9657-4882-91d1-b99fc312b951 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.148950 Sep 15 13:00:20.586295 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 124/243] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:20 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:21.609073 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-460b2253-6b46-457e-b641-059448edfd89 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:21.609612 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-460b2253-6b46-457e-b641-059448edfd89 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:21.615637 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-460b2253-6b46-457e-b641-059448edfd89 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:21.616113 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-460b2253-6b46-457e-b641-059448edfd89 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:21.616586 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-460b2253-6b46-457e-b641-059448edfd89 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:21.617263 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-460b2253-6b46-457e-b641-059448edfd89 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:21.617707 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-460b2253-6b46-457e-b641-059448edfd89 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:21.618670 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-460b2253-6b46-457e-b641-059448edfd89 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:21.744855 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-460b2253-6b46-457e-b641-059448edfd89 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:21.752428 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-460b2253-6b46-457e-b641-059448edfd89 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.147577 Sep 15 13:00:21.753013 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 120/244] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:21 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:22.776416 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b25d5aa0-9654-4bcc-b887-4174d75bf08e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:22.776950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b25d5aa0-9654-4bcc-b887-4174d75bf08e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:22.783443 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b25d5aa0-9654-4bcc-b887-4174d75bf08e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:22.783929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b25d5aa0-9654-4bcc-b887-4174d75bf08e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:22.784393 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b25d5aa0-9654-4bcc-b887-4174d75bf08e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:22.785082 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b25d5aa0-9654-4bcc-b887-4174d75bf08e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:22.785532 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b25d5aa0-9654-4bcc-b887-4174d75bf08e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:22.785952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b25d5aa0-9654-4bcc-b887-4174d75bf08e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:22.790557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=79 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:22.917019 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b25d5aa0-9654-4bcc-b887-4174d75bf08e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:22.924911 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b25d5aa0-9654-4bcc-b887-4174d75bf08e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.152457 Sep 15 13:00:22.925468 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 125/245] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:22 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:23.948003 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-19059097-9437-48a9-9d81-27975d415cd6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:23.948698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-19059097-9437-48a9-9d81-27975d415cd6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:23.954538 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-19059097-9437-48a9-9d81-27975d415cd6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:23.955019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-19059097-9437-48a9-9d81-27975d415cd6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:23.955688 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-19059097-9437-48a9-9d81-27975d415cd6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:23.956134 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-19059097-9437-48a9-9d81-27975d415cd6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:23.956607 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-19059097-9437-48a9-9d81-27975d415cd6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:23.957026 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-19059097-9437-48a9-9d81-27975d415cd6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:24.088807 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-19059097-9437-48a9-9d81-27975d415cd6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:24.096517 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-19059097-9437-48a9-9d81-27975d415cd6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.153569 Sep 15 13:00:24.097090 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 121/246] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:23 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:25.119771 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-55001515-e18f-4194-8fa9-974fc3c54aae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:25.120420 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-55001515-e18f-4194-8fa9-974fc3c54aae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:25.126862 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55001515-e18f-4194-8fa9-974fc3c54aae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:25.127341 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55001515-e18f-4194-8fa9-974fc3c54aae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:25.127775 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55001515-e18f-4194-8fa9-974fc3c54aae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:25.128494 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55001515-e18f-4194-8fa9-974fc3c54aae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:25.128946 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55001515-e18f-4194-8fa9-974fc3c54aae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:25.129363 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55001515-e18f-4194-8fa9-974fc3c54aae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:25.259450 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-55001515-e18f-4194-8fa9-974fc3c54aae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:25.267423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-55001515-e18f-4194-8fa9-974fc3c54aae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.152103 Sep 15 13:00:25.267973 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 126/247] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:25 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:26.290841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d9a4dfa4-3b86-40a8-83dd-fcd1e59a9b8b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:26.291390 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d9a4dfa4-3b86-40a8-83dd-fcd1e59a9b8b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:26.293645 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=28 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:26.299454 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d9a4dfa4-3b86-40a8-83dd-fcd1e59a9b8b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:26.299935 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d9a4dfa4-3b86-40a8-83dd-fcd1e59a9b8b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:26.300392 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d9a4dfa4-3b86-40a8-83dd-fcd1e59a9b8b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:26.301076 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d9a4dfa4-3b86-40a8-83dd-fcd1e59a9b8b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:26.301521 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d9a4dfa4-3b86-40a8-83dd-fcd1e59a9b8b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:26.301936 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d9a4dfa4-3b86-40a8-83dd-fcd1e59a9b8b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:26.429743 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d9a4dfa4-3b86-40a8-83dd-fcd1e59a9b8b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:26.438320 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d9a4dfa4-3b86-40a8-83dd-fcd1e59a9b8b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.151863 Sep 15 13:00:26.438880 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 122/248] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:26 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:27.461452 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b020205c-5556-4849-98cd-287684749854 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:27.462059 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b020205c-5556-4849-98cd-287684749854 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:27.468431 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b020205c-5556-4849-98cd-287684749854 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:27.468917 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b020205c-5556-4849-98cd-287684749854 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:27.469351 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b020205c-5556-4849-98cd-287684749854 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:27.470040 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b020205c-5556-4849-98cd-287684749854 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:27.470521 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b020205c-5556-4849-98cd-287684749854 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:27.470946 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b020205c-5556-4849-98cd-287684749854 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:27.601291 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b020205c-5556-4849-98cd-287684749854 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:27.608921 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b020205c-5556-4849-98cd-287684749854 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.151261 Sep 15 13:00:27.609496 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 127/249] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:27 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:28.632171 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1e0360be-14d7-4232-a686-99dd265d55c2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:28.632744 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1e0360be-14d7-4232-a686-99dd265d55c2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:28.638869 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e0360be-14d7-4232-a686-99dd265d55c2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:28.639352 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e0360be-14d7-4232-a686-99dd265d55c2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:28.639792 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e0360be-14d7-4232-a686-99dd265d55c2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:28.640504 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e0360be-14d7-4232-a686-99dd265d55c2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:28.640959 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e0360be-14d7-4232-a686-99dd265d55c2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:28.641378 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e0360be-14d7-4232-a686-99dd265d55c2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:28.766537 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1e0360be-14d7-4232-a686-99dd265d55c2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:28.775943 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1e0360be-14d7-4232-a686-99dd265d55c2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.147593 Sep 15 13:00:28.776552 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 123/250] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:28 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:29.798653 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-995381db-ff90-4d28-98f1-a77bbbca8dd1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:29.799197 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-995381db-ff90-4d28-98f1-a77bbbca8dd1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:29.805552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-995381db-ff90-4d28-98f1-a77bbbca8dd1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:29.806031 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-995381db-ff90-4d28-98f1-a77bbbca8dd1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:29.806461 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-995381db-ff90-4d28-98f1-a77bbbca8dd1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:29.807166 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-995381db-ff90-4d28-98f1-a77bbbca8dd1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:29.807618 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-995381db-ff90-4d28-98f1-a77bbbca8dd1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:29.808037 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-995381db-ff90-4d28-98f1-a77bbbca8dd1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:29.932119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-995381db-ff90-4d28-98f1-a77bbbca8dd1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:29.939784 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-995381db-ff90-4d28-98f1-a77bbbca8dd1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.145210 Sep 15 13:00:29.940371 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 128/251] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:29 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:30.963039 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-abfa1b7b-125d-4c34-9d5e-b264d5aa7e04 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:30.963786 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-abfa1b7b-125d-4c34-9d5e-b264d5aa7e04 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:30.969723 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abfa1b7b-125d-4c34-9d5e-b264d5aa7e04 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:30.970200 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abfa1b7b-125d-4c34-9d5e-b264d5aa7e04 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:30.970629 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abfa1b7b-125d-4c34-9d5e-b264d5aa7e04 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:30.971310 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abfa1b7b-125d-4c34-9d5e-b264d5aa7e04 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:30.971760 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abfa1b7b-125d-4c34-9d5e-b264d5aa7e04 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:30.972178 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abfa1b7b-125d-4c34-9d5e-b264d5aa7e04 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:31.102502 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-abfa1b7b-125d-4c34-9d5e-b264d5aa7e04 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:31.111021 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-abfa1b7b-125d-4c34-9d5e-b264d5aa7e04 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.151867 Sep 15 13:00:31.111592 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 124/252] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:30 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:32.133909 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4a54b57a-d4d9-4ace-be34-24e88e0c6e75 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:32.134514 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-4a54b57a-d4d9-4ace-be34-24e88e0c6e75 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:32.141700 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4a54b57a-d4d9-4ace-be34-24e88e0c6e75 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:32.142432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4a54b57a-d4d9-4ace-be34-24e88e0c6e75 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:32.142864 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4a54b57a-d4d9-4ace-be34-24e88e0c6e75 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:32.143540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4a54b57a-d4d9-4ace-be34-24e88e0c6e75 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:32.143982 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4a54b57a-d4d9-4ace-be34-24e88e0c6e75 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:32.144427 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4a54b57a-d4d9-4ace-be34-24e88e0c6e75 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:32.275134 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4a54b57a-d4d9-4ace-be34-24e88e0c6e75 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:32.283329 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-4a54b57a-d4d9-4ace-be34-24e88e0c6e75 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.153257 Sep 15 13:00:32.283890 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 129/253] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:32 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:33.305758 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8187a625-25b6-4eb9-9045-d9fe493af6b2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:33.306394 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8187a625-25b6-4eb9-9045-d9fe493af6b2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:33.313212 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8187a625-25b6-4eb9-9045-d9fe493af6b2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:33.313702 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8187a625-25b6-4eb9-9045-d9fe493af6b2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:33.314141 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8187a625-25b6-4eb9-9045-d9fe493af6b2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:33.314834 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8187a625-25b6-4eb9-9045-d9fe493af6b2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:33.315291 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8187a625-25b6-4eb9-9045-d9fe493af6b2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:33.315718 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8187a625-25b6-4eb9-9045-d9fe493af6b2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:33.442774 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8187a625-25b6-4eb9-9045-d9fe493af6b2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:33.451731 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8187a625-25b6-4eb9-9045-d9fe493af6b2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1522 microversion: 2.1 time: 0.149715 Sep 15 13:00:33.452388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 125/254] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:33 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:34.473926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4c41a6ef-e3c2-48b3-9cfc-651a2880d958 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:34.474543 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-4c41a6ef-e3c2-48b3-9cfc-651a2880d958 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:34.481662 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4c41a6ef-e3c2-48b3-9cfc-651a2880d958 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:34.482155 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4c41a6ef-e3c2-48b3-9cfc-651a2880d958 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:34.482588 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4c41a6ef-e3c2-48b3-9cfc-651a2880d958 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:34.483285 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4c41a6ef-e3c2-48b3-9cfc-651a2880d958 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:34.486474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4c41a6ef-e3c2-48b3-9cfc-651a2880d958 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:34.486474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4c41a6ef-e3c2-48b3-9cfc-651a2880d958 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:34.630918 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4c41a6ef-e3c2-48b3-9cfc-651a2880d958 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:34.642547 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-4c41a6ef-e3c2-48b3-9cfc-651a2880d958 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1502 microversion: 2.1 time: 0.172045 Sep 15 13:00:34.643300 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 130/255] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:34 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:00:34.665851 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1689b5e6-20fc-40c4-8d9c-5407934db0af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:34.667689 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1689b5e6-20fc-40c4-8d9c-5407934db0af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:34.675576 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1689b5e6-20fc-40c4-8d9c-5407934db0af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:34.676227 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1689b5e6-20fc-40c4-8d9c-5407934db0af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:34.676896 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1689b5e6-20fc-40c4-8d9c-5407934db0af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:34.679197 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1689b5e6-20fc-40c4-8d9c-5407934db0af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:34.679907 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1689b5e6-20fc-40c4-8d9c-5407934db0af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:34.680857 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1689b5e6-20fc-40c4-8d9c-5407934db0af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:34.827845 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1689b5e6-20fc-40c4-8d9c-5407934db0af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:34.835681 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1689b5e6-20fc-40c4-8d9c-5407934db0af tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1515 microversion: 2.1 time: 0.174064 Sep 15 13:00:34.836251 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 126/256] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:34 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:37.327668 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b4ae845d-4dec-43ed-85df-0a7a17848ef0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:00:37.329783 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b4ae845d-4dec-43ed-85df-0a7a17848ef0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:37.332015 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=26 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:37.337508 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4ae845d-4dec-43ed-85df-0a7a17848ef0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:37.337983 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4ae845d-4dec-43ed-85df-0a7a17848ef0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:37.338412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4ae845d-4dec-43ed-85df-0a7a17848ef0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:37.339918 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4ae845d-4dec-43ed-85df-0a7a17848ef0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:37.340556 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4ae845d-4dec-43ed-85df-0a7a17848ef0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:37.340978 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4ae845d-4dec-43ed-85df-0a7a17848ef0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:37.363714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-b4ae845d-4dec-43ed-85df-0a7a17848ef0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lazy-loading 'flavor' on Instance uuid b19c1c10-a0cf-4be2-907e-d210ec6cddbb {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:00:37.477367 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b4ae845d-4dec-43ed-85df-0a7a17848ef0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "POST /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb/action" status: 200 len: 32 microversion: 2.1 time: 0.153979 Sep 15 13:00:37.477957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 131/257] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Sep 15 13:00:37 2022] POST /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 13:00:37.488054 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2764f83c-93d5-40ca-bb80-4070baf92fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:37.488689 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2764f83c-93d5-40ca-bb80-4070baf92fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:37.494621 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2764f83c-93d5-40ca-bb80-4070baf92fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:37.495716 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2764f83c-93d5-40ca-bb80-4070baf92fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:37.496286 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2764f83c-93d5-40ca-bb80-4070baf92fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:37.497014 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2764f83c-93d5-40ca-bb80-4070baf92fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:37.497469 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2764f83c-93d5-40ca-bb80-4070baf92fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:37.497892 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2764f83c-93d5-40ca-bb80-4070baf92fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:37.625783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2764f83c-93d5-40ca-bb80-4070baf92fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:37.633374 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2764f83c-93d5-40ca-bb80-4070baf92fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.149107 Sep 15 13:00:37.633960 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 127/258] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:37 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:38.656873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-298d10ce-575f-445c-8240-210d731071f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:38.657568 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-298d10ce-575f-445c-8240-210d731071f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:38.664124 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-298d10ce-575f-445c-8240-210d731071f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:38.664620 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-298d10ce-575f-445c-8240-210d731071f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:38.665052 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-298d10ce-575f-445c-8240-210d731071f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:38.665732 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-298d10ce-575f-445c-8240-210d731071f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:38.666177 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-298d10ce-575f-445c-8240-210d731071f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:38.666630 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-298d10ce-575f-445c-8240-210d731071f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:38.793463 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-298d10ce-575f-445c-8240-210d731071f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:38.802638 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-298d10ce-575f-445c-8240-210d731071f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.150470 Sep 15 13:00:38.803203 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 132/259] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:38 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:39.826202 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-840228f2-81b6-4777-bf35-366f22da6fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:39.826818 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-840228f2-81b6-4777-bf35-366f22da6fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:39.832845 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-840228f2-81b6-4777-bf35-366f22da6fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:39.833322 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-840228f2-81b6-4777-bf35-366f22da6fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:39.833762 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-840228f2-81b6-4777-bf35-366f22da6fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:39.834441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-840228f2-81b6-4777-bf35-366f22da6fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:39.834890 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-840228f2-81b6-4777-bf35-366f22da6fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:39.835309 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-840228f2-81b6-4777-bf35-366f22da6fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:39.965682 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-840228f2-81b6-4777-bf35-366f22da6fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:39.973393 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-840228f2-81b6-4777-bf35-366f22da6fb8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.151341 Sep 15 13:00:39.973968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 128/260] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:39 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:40.996385 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-23d61f9c-b2d1-474a-b287-bac035d0f04f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:40.997024 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-23d61f9c-b2d1-474a-b287-bac035d0f04f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:41.003413 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-23d61f9c-b2d1-474a-b287-bac035d0f04f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:41.003885 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-23d61f9c-b2d1-474a-b287-bac035d0f04f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:41.004340 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-23d61f9c-b2d1-474a-b287-bac035d0f04f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:41.005019 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-23d61f9c-b2d1-474a-b287-bac035d0f04f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:41.005470 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-23d61f9c-b2d1-474a-b287-bac035d0f04f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:41.005884 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-23d61f9c-b2d1-474a-b287-bac035d0f04f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:41.135124 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-23d61f9c-b2d1-474a-b287-bac035d0f04f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:41.143457 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-23d61f9c-b2d1-474a-b287-bac035d0f04f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.151102 Sep 15 13:00:41.144023 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 133/261] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:40 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:00:42.167277 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-7c26bffa-52df-4ffd-a636-7008e2c808a2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:42.167821 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-7c26bffa-52df-4ffd-a636-7008e2c808a2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:42.173902 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c26bffa-52df-4ffd-a636-7008e2c808a2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:42.174402 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c26bffa-52df-4ffd-a636-7008e2c808a2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:42.174884 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c26bffa-52df-4ffd-a636-7008e2c808a2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:42.175481 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c26bffa-52df-4ffd-a636-7008e2c808a2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:42.175928 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c26bffa-52df-4ffd-a636-7008e2c808a2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:42.176368 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c26bffa-52df-4ffd-a636-7008e2c808a2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:42.309884 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-7c26bffa-52df-4ffd-a636-7008e2c808a2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:42.317983 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-7c26bffa-52df-4ffd-a636-7008e2c808a2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.155047 Sep 15 13:00:42.318561 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 129/262] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:42 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:43.343028 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b59f72fd-c087-4c74-b376-c933b35c8a88 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:43.345041 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b59f72fd-c087-4c74-b376-c933b35c8a88 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:43.351858 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b59f72fd-c087-4c74-b376-c933b35c8a88 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:43.352380 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b59f72fd-c087-4c74-b376-c933b35c8a88 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:43.352813 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b59f72fd-c087-4c74-b376-c933b35c8a88 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:43.353687 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b59f72fd-c087-4c74-b376-c933b35c8a88 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:43.354349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b59f72fd-c087-4c74-b376-c933b35c8a88 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:43.354857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b59f72fd-c087-4c74-b376-c933b35c8a88 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:43.531936 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b59f72fd-c087-4c74-b376-c933b35c8a88 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:43.539634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b59f72fd-c087-4c74-b376-c933b35c8a88 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.202788 Sep 15 13:00:43.540190 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 134/263] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:43 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:44.563601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-11888598-1fbe-4c70-b1bf-73d744b4d0ba tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:44.564665 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-11888598-1fbe-4c70-b1bf-73d744b4d0ba tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:44.570719 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-11888598-1fbe-4c70-b1bf-73d744b4d0ba tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:44.571444 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-11888598-1fbe-4c70-b1bf-73d744b4d0ba tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:44.571975 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-11888598-1fbe-4c70-b1bf-73d744b4d0ba tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:44.572768 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-11888598-1fbe-4c70-b1bf-73d744b4d0ba tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:44.573292 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-11888598-1fbe-4c70-b1bf-73d744b4d0ba tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:44.574468 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-11888598-1fbe-4c70-b1bf-73d744b4d0ba tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:44.730970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-11888598-1fbe-4c70-b1bf-73d744b4d0ba tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:44.742999 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-11888598-1fbe-4c70-b1bf-73d744b4d0ba tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.183181 Sep 15 13:00:44.744733 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 130/264] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:44 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:45.772233 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0ef7af73-02a3-451f-bf03-50a7bc90f8e6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:45.772948 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0ef7af73-02a3-451f-bf03-50a7bc90f8e6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:45.779914 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ef7af73-02a3-451f-bf03-50a7bc90f8e6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:45.780431 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ef7af73-02a3-451f-bf03-50a7bc90f8e6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:45.780864 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ef7af73-02a3-451f-bf03-50a7bc90f8e6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:45.781547 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ef7af73-02a3-451f-bf03-50a7bc90f8e6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:45.781995 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ef7af73-02a3-451f-bf03-50a7bc90f8e6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:45.782415 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ef7af73-02a3-451f-bf03-50a7bc90f8e6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:45.912426 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0ef7af73-02a3-451f-bf03-50a7bc90f8e6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:45.920833 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0ef7af73-02a3-451f-bf03-50a7bc90f8e6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.152460 Sep 15 13:00:45.921408 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 135/265] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:45 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:46.943256 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a0b612ed-1f61-447d-ba5d-1758caaf5864 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:46.943904 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a0b612ed-1f61-447d-ba5d-1758caaf5864 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:46.950643 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0b612ed-1f61-447d-ba5d-1758caaf5864 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:46.951128 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0b612ed-1f61-447d-ba5d-1758caaf5864 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:46.951562 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0b612ed-1f61-447d-ba5d-1758caaf5864 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:46.952250 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0b612ed-1f61-447d-ba5d-1758caaf5864 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:46.952728 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0b612ed-1f61-447d-ba5d-1758caaf5864 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:46.953148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0b612ed-1f61-447d-ba5d-1758caaf5864 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:46.969499 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=80 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:47.079659 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a0b612ed-1f61-447d-ba5d-1758caaf5864 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:47.087509 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a0b612ed-1f61-447d-ba5d-1758caaf5864 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.148054 Sep 15 13:00:47.088082 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 131/266] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:46 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:48.109982 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-eadb23ff-9d44-46a7-ba0c-2f696e5f031b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:48.110580 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-eadb23ff-9d44-46a7-ba0c-2f696e5f031b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:48.117052 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eadb23ff-9d44-46a7-ba0c-2f696e5f031b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:48.117529 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eadb23ff-9d44-46a7-ba0c-2f696e5f031b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:48.117965 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eadb23ff-9d44-46a7-ba0c-2f696e5f031b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:48.118647 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eadb23ff-9d44-46a7-ba0c-2f696e5f031b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:48.119093 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eadb23ff-9d44-46a7-ba0c-2f696e5f031b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:48.119510 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eadb23ff-9d44-46a7-ba0c-2f696e5f031b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:48.244787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-eadb23ff-9d44-46a7-ba0c-2f696e5f031b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:48.252726 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-eadb23ff-9d44-46a7-ba0c-2f696e5f031b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.146641 Sep 15 13:00:48.253296 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 136/267] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:48 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:49.276012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b4406305-34ec-4987-ade8-411f1825c1d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:49.277537 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b4406305-34ec-4987-ade8-411f1825c1d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:49.283627 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b4406305-34ec-4987-ade8-411f1825c1d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:49.284103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b4406305-34ec-4987-ade8-411f1825c1d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:49.284598 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b4406305-34ec-4987-ade8-411f1825c1d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:49.285283 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b4406305-34ec-4987-ade8-411f1825c1d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:49.285732 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b4406305-34ec-4987-ade8-411f1825c1d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:49.286145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b4406305-34ec-4987-ade8-411f1825c1d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:49.412263 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b4406305-34ec-4987-ade8-411f1825c1d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:49.420590 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b4406305-34ec-4987-ade8-411f1825c1d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.148405 Sep 15 13:00:49.421147 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 132/268] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:49 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:50.443813 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-dbd9e739-3d71-4a9d-a44d-08f48d15ca6e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:50.444415 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-dbd9e739-3d71-4a9d-a44d-08f48d15ca6e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:50.451263 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dbd9e739-3d71-4a9d-a44d-08f48d15ca6e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:50.451742 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dbd9e739-3d71-4a9d-a44d-08f48d15ca6e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:50.452185 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dbd9e739-3d71-4a9d-a44d-08f48d15ca6e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:50.452926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dbd9e739-3d71-4a9d-a44d-08f48d15ca6e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:50.453378 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dbd9e739-3d71-4a9d-a44d-08f48d15ca6e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:50.453799 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dbd9e739-3d71-4a9d-a44d-08f48d15ca6e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:50.578664 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-dbd9e739-3d71-4a9d-a44d-08f48d15ca6e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:50.586274 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-dbd9e739-3d71-4a9d-a44d-08f48d15ca6e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.146373 Sep 15 13:00:50.586835 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 137/269] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:50 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:51.609796 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d207ad0e-50be-498c-ba90-70124337f6d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:51.610433 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d207ad0e-50be-498c-ba90-70124337f6d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:51.616295 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d207ad0e-50be-498c-ba90-70124337f6d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:51.616772 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d207ad0e-50be-498c-ba90-70124337f6d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:51.617203 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d207ad0e-50be-498c-ba90-70124337f6d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:51.617878 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d207ad0e-50be-498c-ba90-70124337f6d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:51.618324 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d207ad0e-50be-498c-ba90-70124337f6d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:51.618742 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d207ad0e-50be-498c-ba90-70124337f6d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:51.747475 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d207ad0e-50be-498c-ba90-70124337f6d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:51.754991 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d207ad0e-50be-498c-ba90-70124337f6d1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.149122 Sep 15 13:00:51.755554 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 133/270] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:51 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:52.778873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bbd57d45-4d9d-425d-b25d-3bfc1924e7d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:52.779508 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-bbd57d45-4d9d-425d-b25d-3bfc1924e7d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:52.785936 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bbd57d45-4d9d-425d-b25d-3bfc1924e7d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:52.786409 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bbd57d45-4d9d-425d-b25d-3bfc1924e7d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:52.786836 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bbd57d45-4d9d-425d-b25d-3bfc1924e7d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:52.787513 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bbd57d45-4d9d-425d-b25d-3bfc1924e7d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:52.787953 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bbd57d45-4d9d-425d-b25d-3bfc1924e7d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:52.788398 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bbd57d45-4d9d-425d-b25d-3bfc1924e7d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:52.807108 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:52.920418 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-bbd57d45-4d9d-425d-b25d-3bfc1924e7d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:52.927948 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-bbd57d45-4d9d-425d-b25d-3bfc1924e7d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.153286 Sep 15 13:00:52.928546 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 138/271] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:52 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:53.949972 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0f86a085-530f-4026-8bad-859c1813792b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:53.950584 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0f86a085-530f-4026-8bad-859c1813792b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:53.956605 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f86a085-530f-4026-8bad-859c1813792b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:53.957103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f86a085-530f-4026-8bad-859c1813792b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:53.957519 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f86a085-530f-4026-8bad-859c1813792b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:53.958201 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f86a085-530f-4026-8bad-859c1813792b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:53.958648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f86a085-530f-4026-8bad-859c1813792b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:53.959067 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f86a085-530f-4026-8bad-859c1813792b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:54.084032 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0f86a085-530f-4026-8bad-859c1813792b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:54.091863 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0f86a085-530f-4026-8bad-859c1813792b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.145772 Sep 15 13:00:54.092563 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 134/272] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:53 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:55.114965 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-111c070d-980f-4c63-98a8-33b15fbd29c9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:55.115574 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-111c070d-980f-4c63-98a8-33b15fbd29c9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:55.122677 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-111c070d-980f-4c63-98a8-33b15fbd29c9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:55.123157 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-111c070d-980f-4c63-98a8-33b15fbd29c9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:55.123592 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-111c070d-980f-4c63-98a8-33b15fbd29c9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:55.124294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-111c070d-980f-4c63-98a8-33b15fbd29c9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:55.124747 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-111c070d-980f-4c63-98a8-33b15fbd29c9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:55.125165 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-111c070d-980f-4c63-98a8-33b15fbd29c9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:55.252605 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-111c070d-980f-4c63-98a8-33b15fbd29c9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:55.260137 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-111c070d-980f-4c63-98a8-33b15fbd29c9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.149071 Sep 15 13:00:55.260725 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 139/273] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:55 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:56.283748 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-bb7404e8-45f4-427c-8d11-829795bcc648 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:56.284383 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-bb7404e8-45f4-427c-8d11-829795bcc648 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:56.290263 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bb7404e8-45f4-427c-8d11-829795bcc648 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:56.290741 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bb7404e8-45f4-427c-8d11-829795bcc648 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:56.291177 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bb7404e8-45f4-427c-8d11-829795bcc648 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:56.291858 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bb7404e8-45f4-427c-8d11-829795bcc648 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:56.292595 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bb7404e8-45f4-427c-8d11-829795bcc648 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:56.293019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bb7404e8-45f4-427c-8d11-829795bcc648 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:56.422417 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-bb7404e8-45f4-427c-8d11-829795bcc648 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:56.430207 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-bb7404e8-45f4-427c-8d11-829795bcc648 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.150367 Sep 15 13:00:56.430773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 135/274] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:56 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:57.454315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-38adbe66-bd59-4407-aca7-67a98bd0bc49 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:57.454964 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-38adbe66-bd59-4407-aca7-67a98bd0bc49 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:57.461565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-38adbe66-bd59-4407-aca7-67a98bd0bc49 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:57.462054 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-38adbe66-bd59-4407-aca7-67a98bd0bc49 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:57.462521 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-38adbe66-bd59-4407-aca7-67a98bd0bc49 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:57.463219 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-38adbe66-bd59-4407-aca7-67a98bd0bc49 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:57.463670 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-38adbe66-bd59-4407-aca7-67a98bd0bc49 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:57.464662 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-38adbe66-bd59-4407-aca7-67a98bd0bc49 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:57.595593 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-38adbe66-bd59-4407-aca7-67a98bd0bc49 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:57.603282 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-38adbe66-bd59-4407-aca7-67a98bd0bc49 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.152906 Sep 15 13:00:57.603686 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 140/275] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:57 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:58.627345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8d09ebf8-5173-4519-ac9b-580b64d89bdd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:58.627946 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8d09ebf8-5173-4519-ac9b-580b64d89bdd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:58.629787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=28 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:58.635221 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8d09ebf8-5173-4519-ac9b-580b64d89bdd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:58.635724 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8d09ebf8-5173-4519-ac9b-580b64d89bdd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:58.636517 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8d09ebf8-5173-4519-ac9b-580b64d89bdd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:58.637229 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8d09ebf8-5173-4519-ac9b-580b64d89bdd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:58.637676 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8d09ebf8-5173-4519-ac9b-580b64d89bdd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:58.638089 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8d09ebf8-5173-4519-ac9b-580b64d89bdd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:58.764365 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8d09ebf8-5173-4519-ac9b-580b64d89bdd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:58.772485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8d09ebf8-5173-4519-ac9b-580b64d89bdd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.148827 Sep 15 13:00:58.773061 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 136/276] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:58 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:00:59.796328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-46979d5e-5487-4931-b079-0df174db9f50 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:00:59.796860 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-46979d5e-5487-4931-b079-0df174db9f50 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:00:59.803158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46979d5e-5487-4931-b079-0df174db9f50 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:59.803877 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46979d5e-5487-4931-b079-0df174db9f50 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:59.804061 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46979d5e-5487-4931-b079-0df174db9f50 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:59.804777 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46979d5e-5487-4931-b079-0df174db9f50 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:00:59.805228 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46979d5e-5487-4931-b079-0df174db9f50 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:00:59.805645 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46979d5e-5487-4931-b079-0df174db9f50 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:00:59.932486 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-46979d5e-5487-4931-b079-0df174db9f50 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:00:59.940071 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-46979d5e-5487-4931-b079-0df174db9f50 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.148483 Sep 15 13:00:59.940668 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 141/277] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:00:59 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:00.962744 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-80803419-cf9d-413e-ab65-de4ef5a2bd86 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:00.963381 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-80803419-cf9d-413e-ab65-de4ef5a2bd86 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:00.969269 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-80803419-cf9d-413e-ab65-de4ef5a2bd86 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:00.969746 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-80803419-cf9d-413e-ab65-de4ef5a2bd86 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:00.970173 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-80803419-cf9d-413e-ab65-de4ef5a2bd86 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:00.970848 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-80803419-cf9d-413e-ab65-de4ef5a2bd86 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:00.971294 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-80803419-cf9d-413e-ab65-de4ef5a2bd86 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:00.971710 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-80803419-cf9d-413e-ab65-de4ef5a2bd86 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:01.101718 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-80803419-cf9d-413e-ab65-de4ef5a2bd86 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:01.110111 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-80803419-cf9d-413e-ab65-de4ef5a2bd86 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.151091 Sep 15 13:01:01.110663 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 137/278] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:00 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:02.132866 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-df7b2905-19fc-4fce-a2d8-d6ed896588f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:02.133478 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-df7b2905-19fc-4fce-a2d8-d6ed896588f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:02.139946 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-df7b2905-19fc-4fce-a2d8-d6ed896588f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:02.140493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-df7b2905-19fc-4fce-a2d8-d6ed896588f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:02.140932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-df7b2905-19fc-4fce-a2d8-d6ed896588f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:02.141613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-df7b2905-19fc-4fce-a2d8-d6ed896588f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:02.142063 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-df7b2905-19fc-4fce-a2d8-d6ed896588f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:02.142748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-df7b2905-19fc-4fce-a2d8-d6ed896588f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:02.270057 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-df7b2905-19fc-4fce-a2d8-d6ed896588f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:02.278178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-df7b2905-19fc-4fce-a2d8-d6ed896588f5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.149115 Sep 15 13:01:02.278748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 142/279] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:02 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:03.301042 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-bde270f0-b547-428d-9cae-21d7c3429a1a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:03.301580 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-bde270f0-b547-428d-9cae-21d7c3429a1a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:03.308106 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bde270f0-b547-428d-9cae-21d7c3429a1a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:03.308738 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bde270f0-b547-428d-9cae-21d7c3429a1a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:03.309171 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bde270f0-b547-428d-9cae-21d7c3429a1a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:03.309856 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bde270f0-b547-428d-9cae-21d7c3429a1a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:03.310307 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bde270f0-b547-428d-9cae-21d7c3429a1a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:03.310734 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bde270f0-b547-428d-9cae-21d7c3429a1a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:03.439464 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-bde270f0-b547-428d-9cae-21d7c3429a1a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:03.447127 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-bde270f0-b547-428d-9cae-21d7c3429a1a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.150109 Sep 15 13:01:03.447699 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 138/280] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:03 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:04.469738 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a86130c8-591f-4f59-98fb-6945938bdc06 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:04.470352 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a86130c8-591f-4f59-98fb-6945938bdc06 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:04.476626 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a86130c8-591f-4f59-98fb-6945938bdc06 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:04.477110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a86130c8-591f-4f59-98fb-6945938bdc06 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:04.477625 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a86130c8-591f-4f59-98fb-6945938bdc06 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:04.478314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a86130c8-591f-4f59-98fb-6945938bdc06 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:04.478769 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a86130c8-591f-4f59-98fb-6945938bdc06 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:04.479188 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a86130c8-591f-4f59-98fb-6945938bdc06 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:04.607428 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a86130c8-591f-4f59-98fb-6945938bdc06 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:04.614975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a86130c8-591f-4f59-98fb-6945938bdc06 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.149755 Sep 15 13:01:04.615531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 143/281] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:04 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:01:05.638084 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3a4b3ab5-98db-4050-b446-85acadbc6f7a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:05.638613 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3a4b3ab5-98db-4050-b446-85acadbc6f7a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:05.644739 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a4b3ab5-98db-4050-b446-85acadbc6f7a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:05.645211 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a4b3ab5-98db-4050-b446-85acadbc6f7a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:05.645638 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a4b3ab5-98db-4050-b446-85acadbc6f7a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:05.646311 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a4b3ab5-98db-4050-b446-85acadbc6f7a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:05.646752 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a4b3ab5-98db-4050-b446-85acadbc6f7a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:05.647171 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a4b3ab5-98db-4050-b446-85acadbc6f7a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:05.778828 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3a4b3ab5-98db-4050-b446-85acadbc6f7a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:05.786414 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3a4b3ab5-98db-4050-b446-85acadbc6f7a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.152501 Sep 15 13:01:05.786983 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 139/282] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:05 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:06.811112 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a470a0a0-b9c8-4d42-b09d-53bb38e0f0ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:06.811728 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a470a0a0-b9c8-4d42-b09d-53bb38e0f0ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:06.818373 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a470a0a0-b9c8-4d42-b09d-53bb38e0f0ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:06.818848 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a470a0a0-b9c8-4d42-b09d-53bb38e0f0ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:06.819290 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a470a0a0-b9c8-4d42-b09d-53bb38e0f0ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:06.820053 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a470a0a0-b9c8-4d42-b09d-53bb38e0f0ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:06.820736 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a470a0a0-b9c8-4d42-b09d-53bb38e0f0ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:06.821158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a470a0a0-b9c8-4d42-b09d-53bb38e0f0ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:06.955622 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a470a0a0-b9c8-4d42-b09d-53bb38e0f0ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:06.963573 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a470a0a0-b9c8-4d42-b09d-53bb38e0f0ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1501 microversion: 2.1 time: 0.157216 Sep 15 13:01:06.964146 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 144/283] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:06 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:06.986683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f655cfa7-6bb7-479e-b2e8-94747982c847 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7281dfa8-75f8-48a5-b37b-9539c0ccd762"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:01:06.989272 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f655cfa7-6bb7-479e-b2e8-94747982c847 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:06.995248 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f655cfa7-6bb7-479e-b2e8-94747982c847 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:06.996549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f655cfa7-6bb7-479e-b2e8-94747982c847 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:06.996971 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f655cfa7-6bb7-479e-b2e8-94747982c847 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:06.997693 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f655cfa7-6bb7-479e-b2e8-94747982c847 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:06.998146 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f655cfa7-6bb7-479e-b2e8-94747982c847 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:06.998566 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f655cfa7-6bb7-479e-b2e8-94747982c847 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:07.022002 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-f655cfa7-6bb7-479e-b2e8-94747982c847 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] HTTP exception thrown: Cannot 'attach_volume' instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb while it is in vm_state rescued Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f655cfa7-6bb7-479e-b2e8-94747982c847 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Request method failure captured: Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: POST /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb/os-volume_attachments HTTP/1.1 Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 74 Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyGGCvLr9NLDVLXNqodZA-HvHUau1u28TZ4av1Me93TUra2_ZrMm-nemJSD3Xgpnw_hfXFGIiBR73bkafisfR4v_bKp_0MCgPx-6n1Prv4poDN8_ciPTltTdBEeB323EV2ZAFZg2deCAbtg5TiCZqhByQgp7jHFDyyOpCDrtl1VhhtQ Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: ffff4b9feef3437cb5529aeaaacc3f86 Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:01:07.024238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:01:07.025757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ffff4b9feef3437cb5529aeaaacc3f86", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ffff4b9feef3437cb5529aeaaacc3f86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ffff4b9feef3437cb5529aeaaacc3f86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ffff4b9feef3437cb5529aeaaacc3f86"}]}] Sep 15 13:01:07.025757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:01:07.025757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: ffff4b9feef3437cb5529aeaaacc3f86 Sep 15 13:01:07.025757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:01:07.025757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-ServerRescueNegativeTestJSON-1079457351-project Sep 15 13:01:07.025757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:01:07.025757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:01:07.025757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: e2ef1277bf944722aa33077985fb4734 Sep 15 13:01:07.025757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1079457351-project Sep 15 13:01:07.025757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Sep 15 13:01:07.025757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {"volumeAttachment": {"volumeId": "7281dfa8-75f8-48a5-b37b-9539c0ccd762"}} Sep 15 13:01:07.025757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Cannot 'attach_volume' instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb while it is in vm_state rescued Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'server_id': 'b19c1c10-a0cf-4be2-907e-d210ec6cddbb', 'body': {'volumeAttachment': {'volumeId': '7281dfa8-75f8-48a5-b37b-9539c0ccd762'}}} Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:01:07.026636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb while it is in vm_state rescued Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:01:07.028691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:01:07.029716 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:01:07.029716 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:01:07.029716 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb while it is in vm_state rescued Sep 15 13:01:07.029716 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:01:07.029716 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f655cfa7-6bb7-479e-b2e8-94747982c847 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Returning 409 to user: Cannot 'attach_volume' instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb while it is in vm_state rescued {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:01:07.029716 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f655cfa7-6bb7-479e-b2e8-94747982c847 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "POST /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043166 Sep 15 13:01:07.029716 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 140/284] 10.222.0.57 () {60 vars in 1323 bytes} [Thu Sep 15 13:01:06 2022] POST /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 15 13:01:07.035765 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5f3b4eb9-4b09-4e05-bedb-4464ce4d453a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:01:07.036318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-5f3b4eb9-4b09-4e05-bedb-4464ce4d453a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:07.042187 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f3b4eb9-4b09-4e05-bedb-4464ce4d453a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:07.043284 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f3b4eb9-4b09-4e05-bedb-4464ce4d453a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:07.043765 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f3b4eb9-4b09-4e05-bedb-4464ce4d453a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:07.044524 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f3b4eb9-4b09-4e05-bedb-4464ce4d453a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:07.044982 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f3b4eb9-4b09-4e05-bedb-4464ce4d453a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:07.045402 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f3b4eb9-4b09-4e05-bedb-4464ce4d453a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:07.117937 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-5f3b4eb9-4b09-4e05-bedb-4464ce4d453a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "POST /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb/action" status: 202 len: 0 microversion: 2.1 time: 0.085871 Sep 15 13:01:07.118637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 145/285] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Sep 15 13:01:07 2022] POST /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:01:07.127445 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fd5cefd7-051b-477e-bfb0-c8d05167c51b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:07.128144 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-fd5cefd7-051b-477e-bfb0-c8d05167c51b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:07.134164 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fd5cefd7-051b-477e-bfb0-c8d05167c51b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:07.134645 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fd5cefd7-051b-477e-bfb0-c8d05167c51b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:07.135076 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fd5cefd7-051b-477e-bfb0-c8d05167c51b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:07.135767 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fd5cefd7-051b-477e-bfb0-c8d05167c51b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:07.136217 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fd5cefd7-051b-477e-bfb0-c8d05167c51b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:07.137507 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fd5cefd7-051b-477e-bfb0-c8d05167c51b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:07.350711 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-fd5cefd7-051b-477e-bfb0-c8d05167c51b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:07.359255 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-fd5cefd7-051b-477e-bfb0-c8d05167c51b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1509 microversion: 2.1 time: 0.235582 Sep 15 13:01:07.359855 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 141/286] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:07 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:08.383401 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-dd4c3677-047e-47bf-9076-2820841df9a1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:08.384102 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-dd4c3677-047e-47bf-9076-2820841df9a1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:08.386104 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=30 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:08.391739 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dd4c3677-047e-47bf-9076-2820841df9a1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:08.392223 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dd4c3677-047e-47bf-9076-2820841df9a1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:08.392944 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dd4c3677-047e-47bf-9076-2820841df9a1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:08.393635 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dd4c3677-047e-47bf-9076-2820841df9a1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:08.394085 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dd4c3677-047e-47bf-9076-2820841df9a1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:08.394502 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dd4c3677-047e-47bf-9076-2820841df9a1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:08.530947 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-dd4c3677-047e-47bf-9076-2820841df9a1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:08.539419 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-dd4c3677-047e-47bf-9076-2820841df9a1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1509 microversion: 2.1 time: 0.160710 Sep 15 13:01:08.539994 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 146/287] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:08 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:09.563281 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-212e919a-442a-40dd-a24b-90554e463a2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:09.563892 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-212e919a-442a-40dd-a24b-90554e463a2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:09.569819 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-212e919a-442a-40dd-a24b-90554e463a2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:09.570301 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-212e919a-442a-40dd-a24b-90554e463a2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:09.570732 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-212e919a-442a-40dd-a24b-90554e463a2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:09.571426 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-212e919a-442a-40dd-a24b-90554e463a2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:09.571880 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-212e919a-442a-40dd-a24b-90554e463a2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:09.572319 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-212e919a-442a-40dd-a24b-90554e463a2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:09.708619 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-212e919a-442a-40dd-a24b-90554e463a2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:09.716804 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-212e919a-442a-40dd-a24b-90554e463a2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1509 microversion: 2.1 time: 0.157338 Sep 15 13:01:09.717374 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 142/288] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:09 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:10.740013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-027d7d16-b3c8-496a-b953-82923078db95 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:10.740650 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-027d7d16-b3c8-496a-b953-82923078db95 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:10.763474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-027d7d16-b3c8-496a-b953-82923078db95 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:10.763970 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-027d7d16-b3c8-496a-b953-82923078db95 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:10.764449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-027d7d16-b3c8-496a-b953-82923078db95 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:10.765157 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-027d7d16-b3c8-496a-b953-82923078db95 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:10.765614 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-027d7d16-b3c8-496a-b953-82923078db95 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:10.766038 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-027d7d16-b3c8-496a-b953-82923078db95 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:10.937436 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-027d7d16-b3c8-496a-b953-82923078db95 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:10.947072 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-027d7d16-b3c8-496a-b953-82923078db95 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1509 microversion: 2.1 time: 0.210799 Sep 15 13:01:10.947734 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 147/289] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:10 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:11.971839 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6c7f61dd-5ba6-4444-9d15-68f5ca3a4b67 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:11.972487 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6c7f61dd-5ba6-4444-9d15-68f5ca3a4b67 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:11.978491 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6c7f61dd-5ba6-4444-9d15-68f5ca3a4b67 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:11.978969 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6c7f61dd-5ba6-4444-9d15-68f5ca3a4b67 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:11.979402 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6c7f61dd-5ba6-4444-9d15-68f5ca3a4b67 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:11.980090 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6c7f61dd-5ba6-4444-9d15-68f5ca3a4b67 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:11.981170 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6c7f61dd-5ba6-4444-9d15-68f5ca3a4b67 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:11.981878 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6c7f61dd-5ba6-4444-9d15-68f5ca3a4b67 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:12.125102 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6c7f61dd-5ba6-4444-9d15-68f5ca3a4b67 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:12.133230 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6c7f61dd-5ba6-4444-9d15-68f5ca3a4b67 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1515 microversion: 2.1 time: 0.165282 Sep 15 13:01:12.133786 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 143/290] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:11 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:01:18.748235 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-584f3f76-e04c-4024-95a8-f21bb6b57cb5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Action: 'create', calling method: .version_select at 0x7f62c5657040>, body: {"keypair": {"name": "tempest-keypair-730077533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHud1mkDe5mQVqtDSfKwPfhicOIrDifEvwWYequOaiTjiB+AxAky2Ztb+HodkizzIdohV4vRw4S77chXAxr4mMTXmBdP0L9C8JDiGr1Z1QQny0K4Z9QF6BjOUtIKEeXog=="}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:01:18.904145 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-584f3f76-e04c-4024-95a8-f21bb6b57cb5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Getting quotas for project ffff4b9feef3437cb5529aeaaacc3f86. Resources: {'key_pairs'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:01:18.908248 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-584f3f76-e04c-4024-95a8-f21bb6b57cb5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Getting quotas for user e2ef1277bf944722aa33077985fb4734 and project ffff4b9feef3437cb5529aeaaacc3f86. Resources: {'key_pairs'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:01:18.946393 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-584f3f76-e04c-4024-95a8-f21bb6b57cb5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.202661 Sep 15 13:01:18.946988 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 148/291] 10.222.0.57 () {60 vars in 1159 bytes} [Thu Sep 15 13:01:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:01:20.537333 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1040414367", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a4caedd-fe49-46e7-8d75-963bed0357f2"}], "security_groups": [{"name": "tempest-securitygroup--1885642636"}], "key_name": "tempest-keypair-730077533", "user_data": "}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:01:20.664260 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.network.neutron [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] validate_networks() for [('5a4caedd-fe49-46e7-8d75-963bed0357f2', None, None, None, None, None)] {{(pid=120634) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:01:21.083014 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Flavor limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:01:21.084019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Image limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:01:21.084540 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Flavor pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:01:21.084957 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Image pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:01:21.085373 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:01:21.095420 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:21.095875 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:21.096336 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:21.097080 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:21.097625 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:21.097948 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:21.106154 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=74 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:21.119513 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Getting quotas for project ffff4b9feef3437cb5529aeaaacc3f86. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:01:21.124522 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Getting quotas for user e2ef1277bf944722aa33077985fb4734 and project ffff4b9feef3437cb5529aeaaacc3f86. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:01:21.140864 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Going to run 1 instances... {{(pid=120634) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:01:21.140864 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120634) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:01:21.190288 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b80bf531-1dd7-4dec-a0f3-5a738c979041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.657370 Sep 15 13:01:21.190992 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 144/292] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:01:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 13:01:21.202427 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0e20c1fd-21e9-48ad-91da-8dbdcf26501b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:21.203107 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0e20c1fd-21e9-48ad-91da-8dbdcf26501b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:21.206575 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:21.303441 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0e20c1fd-21e9-48ad-91da-8dbdcf26501b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:21.323399 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0e20c1fd-21e9-48ad-91da-8dbdcf26501b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1245 microversion: 2.1 time: 0.124976 Sep 15 13:01:21.324773 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 149/293] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:21 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1245 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:22.348658 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c8ab1b24-761e-4e52-84ef-7490cd2febcc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:22.349460 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c8ab1b24-761e-4e52-84ef-7490cd2febcc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:22.356490 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8ab1b24-761e-4e52-84ef-7490cd2febcc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:22.356988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8ab1b24-761e-4e52-84ef-7490cd2febcc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:22.357527 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8ab1b24-761e-4e52-84ef-7490cd2febcc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:22.358260 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8ab1b24-761e-4e52-84ef-7490cd2febcc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:22.358765 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8ab1b24-761e-4e52-84ef-7490cd2febcc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:22.359196 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8ab1b24-761e-4e52-84ef-7490cd2febcc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:22.421572 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c8ab1b24-761e-4e52-84ef-7490cd2febcc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:22.430053 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c8ab1b24-761e-4e52-84ef-7490cd2febcc tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1297 microversion: 2.1 time: 0.085530 Sep 15 13:01:22.444826 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 145/294] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:22 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:23.454722 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b9867c0e-a5c2-4072-b696-58e5e940e2d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:23.455327 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b9867c0e-a5c2-4072-b696-58e5e940e2d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:23.462153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b9867c0e-a5c2-4072-b696-58e5e940e2d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:23.462610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b9867c0e-a5c2-4072-b696-58e5e940e2d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:23.463035 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b9867c0e-a5c2-4072-b696-58e5e940e2d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:23.463709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b9867c0e-a5c2-4072-b696-58e5e940e2d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:23.464151 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b9867c0e-a5c2-4072-b696-58e5e940e2d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:23.464762 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b9867c0e-a5c2-4072-b696-58e5e940e2d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:23.526784 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b9867c0e-a5c2-4072-b696-58e5e940e2d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:23.535057 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b9867c0e-a5c2-4072-b696-58e5e940e2d8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1297 microversion: 2.1 time: 0.084167 Sep 15 13:01:23.535613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 150/295] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:23 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:24.559074 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fdbba86d-88fc-493b-ada1-6b58077fce0b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:24.559779 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-fdbba86d-88fc-493b-ada1-6b58077fce0b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:24.566012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fdbba86d-88fc-493b-ada1-6b58077fce0b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:24.566498 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fdbba86d-88fc-493b-ada1-6b58077fce0b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:24.566944 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fdbba86d-88fc-493b-ada1-6b58077fce0b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:24.567640 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fdbba86d-88fc-493b-ada1-6b58077fce0b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:24.568090 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fdbba86d-88fc-493b-ada1-6b58077fce0b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:24.568541 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fdbba86d-88fc-493b-ada1-6b58077fce0b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:24.631115 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-fdbba86d-88fc-493b-ada1-6b58077fce0b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:24.639445 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-fdbba86d-88fc-493b-ada1-6b58077fce0b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1297 microversion: 2.1 time: 0.084817 Sep 15 13:01:24.640006 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 146/296] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:24 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:25.662566 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cf83e701-642f-4ff8-a60d-f838546492e3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:25.664011 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cf83e701-642f-4ff8-a60d-f838546492e3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:25.671270 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf83e701-642f-4ff8-a60d-f838546492e3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:25.671759 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf83e701-642f-4ff8-a60d-f838546492e3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:25.672202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf83e701-642f-4ff8-a60d-f838546492e3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:25.672931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf83e701-642f-4ff8-a60d-f838546492e3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:25.673384 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf83e701-642f-4ff8-a60d-f838546492e3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:25.673808 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf83e701-642f-4ff8-a60d-f838546492e3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:25.736980 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cf83e701-642f-4ff8-a60d-f838546492e3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:25.744694 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cf83e701-642f-4ff8-a60d-f838546492e3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1305 microversion: 2.1 time: 0.085990 Sep 15 13:01:25.745275 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 151/297] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:25 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1305 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:26.768081 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d6882db1-7807-4d94-8629-8409d2860329 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:26.768963 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d6882db1-7807-4d94-8629-8409d2860329 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:26.777712 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6882db1-7807-4d94-8629-8409d2860329 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:26.777712 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6882db1-7807-4d94-8629-8409d2860329 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:26.777712 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6882db1-7807-4d94-8629-8409d2860329 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:26.778680 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6882db1-7807-4d94-8629-8409d2860329 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:26.779170 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6882db1-7807-4d94-8629-8409d2860329 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:26.779650 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6882db1-7807-4d94-8629-8409d2860329 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:26.984972 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d6882db1-7807-4d94-8629-8409d2860329 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:26.992528 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d6882db1-7807-4d94-8629-8409d2860329 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.228641 Sep 15 13:01:26.993093 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 147/298] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:26 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:27.558117 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-023f5002-34a1-4d5f-9bcc-cbaf3333a2c8 req-f844306f-1801-4c1b-afa3-bb8c7559978d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4ff8111-8ab2-4e8d-8278-f76f69b76196", "tag": "de279c4f-9053-44d1-aa49-aa402574c2ed"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:01:27.569665 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-023f5002-34a1-4d5f-9bcc-cbaf3333a2c8 req-f844306f-1801-4c1b-afa3-bb8c7559978d service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:27.570210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-023f5002-34a1-4d5f-9bcc-cbaf3333a2c8 req-f844306f-1801-4c1b-afa3-bb8c7559978d service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:27.570685 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-023f5002-34a1-4d5f-9bcc-cbaf3333a2c8 req-f844306f-1801-4c1b-afa3-bb8c7559978d service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:27.583073 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-023f5002-34a1-4d5f-9bcc-cbaf3333a2c8 req-f844306f-1801-4c1b-afa3-bb8c7559978d service nova] Creating event network-changed:de279c4f-9053-44d1-aa49-aa402574c2ed for instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 on hv-cinder-83608 Sep 15 13:01:27.588204 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-023f5002-34a1-4d5f-9bcc-cbaf3333a2c8 req-f844306f-1801-4c1b-afa3-bb8c7559978d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033864 Sep 15 13:01:27.588825 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 152/299] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:01:28.016004 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f01776b7-0bbf-4a13-8b10-67165cd66fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:28.017203 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f01776b7-0bbf-4a13-8b10-67165cd66fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:28.025708 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f01776b7-0bbf-4a13-8b10-67165cd66fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:28.026207 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f01776b7-0bbf-4a13-8b10-67165cd66fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:28.026728 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f01776b7-0bbf-4a13-8b10-67165cd66fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:28.028412 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f01776b7-0bbf-4a13-8b10-67165cd66fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:28.028870 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f01776b7-0bbf-4a13-8b10-67165cd66fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:28.029297 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f01776b7-0bbf-4a13-8b10-67165cd66fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:28.245037 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f01776b7-0bbf-4a13-8b10-67165cd66fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:28.252843 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f01776b7-0bbf-4a13-8b10-67165cd66fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.241610 Sep 15 13:01:28.253412 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 148/300] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:28 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:29.277421 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-800550d9-77c2-4ef8-9a9d-b66af40111a8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:29.278096 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-800550d9-77c2-4ef8-9a9d-b66af40111a8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:29.284218 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-800550d9-77c2-4ef8-9a9d-b66af40111a8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:29.284729 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-800550d9-77c2-4ef8-9a9d-b66af40111a8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:29.285162 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-800550d9-77c2-4ef8-9a9d-b66af40111a8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:29.285852 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-800550d9-77c2-4ef8-9a9d-b66af40111a8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:29.286300 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-800550d9-77c2-4ef8-9a9d-b66af40111a8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:29.286721 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-800550d9-77c2-4ef8-9a9d-b66af40111a8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:29.413413 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-800550d9-77c2-4ef8-9a9d-b66af40111a8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:29.421075 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-800550d9-77c2-4ef8-9a9d-b66af40111a8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.148464 Sep 15 13:01:29.421628 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 153/301] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:29 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:30.443476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e2d29439-f2e3-46a5-977f-c01a3beece72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:30.444033 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-e2d29439-f2e3-46a5-977f-c01a3beece72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:30.445895 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:30.451276 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e2d29439-f2e3-46a5-977f-c01a3beece72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:30.451762 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e2d29439-f2e3-46a5-977f-c01a3beece72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:30.452192 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e2d29439-f2e3-46a5-977f-c01a3beece72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:30.452907 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e2d29439-f2e3-46a5-977f-c01a3beece72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:30.453358 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e2d29439-f2e3-46a5-977f-c01a3beece72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:30.453773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e2d29439-f2e3-46a5-977f-c01a3beece72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:30.585898 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e2d29439-f2e3-46a5-977f-c01a3beece72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:30.594369 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e2d29439-f2e3-46a5-977f-c01a3beece72 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.154769 Sep 15 13:01:30.594970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 149/302] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:30 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:31.616791 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b0395d08-e2fa-49e1-8444-3bda266887d4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:31.617400 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b0395d08-e2fa-49e1-8444-3bda266887d4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:31.619757 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=6 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:31.625481 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b0395d08-e2fa-49e1-8444-3bda266887d4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:31.625959 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b0395d08-e2fa-49e1-8444-3bda266887d4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:31.626387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b0395d08-e2fa-49e1-8444-3bda266887d4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:31.627125 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b0395d08-e2fa-49e1-8444-3bda266887d4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:31.627572 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b0395d08-e2fa-49e1-8444-3bda266887d4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:31.627988 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b0395d08-e2fa-49e1-8444-3bda266887d4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:31.757527 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b0395d08-e2fa-49e1-8444-3bda266887d4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:31.765468 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b0395d08-e2fa-49e1-8444-3bda266887d4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.152516 Sep 15 13:01:31.766027 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 154/303] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:31 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:32.789161 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1d170a2c-8acb-463f-91c3-e84a7da73ab3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:32.789763 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1d170a2c-8acb-463f-91c3-e84a7da73ab3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:32.791571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:32.792236 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=6 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:32.798474 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d170a2c-8acb-463f-91c3-e84a7da73ab3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:32.798935 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d170a2c-8acb-463f-91c3-e84a7da73ab3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:32.799359 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d170a2c-8acb-463f-91c3-e84a7da73ab3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:32.800400 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d170a2c-8acb-463f-91c3-e84a7da73ab3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:32.801012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d170a2c-8acb-463f-91c3-e84a7da73ab3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:32.801629 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1d170a2c-8acb-463f-91c3-e84a7da73ab3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:32.927393 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1d170a2c-8acb-463f-91c3-e84a7da73ab3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:32.935579 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1d170a2c-8acb-463f-91c3-e84a7da73ab3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.150255 Sep 15 13:01:32.936145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 150/304] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:32 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:33.958125 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2c4ce12b-5175-4557-a26b-7758b36635b9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:33.958732 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2c4ce12b-5175-4557-a26b-7758b36635b9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:33.965133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2c4ce12b-5175-4557-a26b-7758b36635b9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:33.965612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2c4ce12b-5175-4557-a26b-7758b36635b9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:33.966689 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2c4ce12b-5175-4557-a26b-7758b36635b9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:33.967388 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2c4ce12b-5175-4557-a26b-7758b36635b9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:33.967851 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2c4ce12b-5175-4557-a26b-7758b36635b9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:33.968252 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2c4ce12b-5175-4557-a26b-7758b36635b9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:34.097770 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2c4ce12b-5175-4557-a26b-7758b36635b9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:34.105462 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2c4ce12b-5175-4557-a26b-7758b36635b9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.151170 Sep 15 13:01:34.106655 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 155/305] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:33 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:01:35.128767 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-01100a51-b340-43c6-85ab-3f680c6b7efa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:35.129371 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-01100a51-b340-43c6-85ab-3f680c6b7efa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:35.135292 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-01100a51-b340-43c6-85ab-3f680c6b7efa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:35.135708 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-01100a51-b340-43c6-85ab-3f680c6b7efa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:35.136133 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-01100a51-b340-43c6-85ab-3f680c6b7efa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:35.136844 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-01100a51-b340-43c6-85ab-3f680c6b7efa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:35.137484 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-01100a51-b340-43c6-85ab-3f680c6b7efa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:35.138164 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-01100a51-b340-43c6-85ab-3f680c6b7efa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:35.264944 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-01100a51-b340-43c6-85ab-3f680c6b7efa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:35.271939 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-01100a51-b340-43c6-85ab-3f680c6b7efa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.146960 Sep 15 13:01:35.272549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 151/306] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:35 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:36.294317 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-53779ff7-b800-4162-b714-cfed0c6bd90b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:36.294922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-53779ff7-b800-4162-b714-cfed0c6bd90b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:36.301421 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-53779ff7-b800-4162-b714-cfed0c6bd90b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:36.301899 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-53779ff7-b800-4162-b714-cfed0c6bd90b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:36.302328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-53779ff7-b800-4162-b714-cfed0c6bd90b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:36.303008 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-53779ff7-b800-4162-b714-cfed0c6bd90b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:36.303458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-53779ff7-b800-4162-b714-cfed0c6bd90b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:36.303875 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-53779ff7-b800-4162-b714-cfed0c6bd90b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:36.430488 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-53779ff7-b800-4162-b714-cfed0c6bd90b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:36.438701 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-53779ff7-b800-4162-b714-cfed0c6bd90b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.148285 Sep 15 13:01:36.439257 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 156/307] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:36 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:37.462487 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a10518ff-3b2a-4b54-82cd-c192319b4e2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:37.463130 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a10518ff-3b2a-4b54-82cd-c192319b4e2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:37.469990 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a10518ff-3b2a-4b54-82cd-c192319b4e2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:37.470476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a10518ff-3b2a-4b54-82cd-c192319b4e2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:37.470883 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a10518ff-3b2a-4b54-82cd-c192319b4e2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:37.471568 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a10518ff-3b2a-4b54-82cd-c192319b4e2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:37.472010 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a10518ff-3b2a-4b54-82cd-c192319b4e2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:37.472458 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a10518ff-3b2a-4b54-82cd-c192319b4e2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:37.622302 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a10518ff-3b2a-4b54-82cd-c192319b4e2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:37.629909 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a10518ff-3b2a-4b54-82cd-c192319b4e2b tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.171740 Sep 15 13:01:37.630475 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 152/308] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:37 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:38.654372 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b6dd503b-92fb-4fc2-abf4-a32ab09d5a02 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:38.654897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b6dd503b-92fb-4fc2-abf4-a32ab09d5a02 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:38.657212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:38.663629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b6dd503b-92fb-4fc2-abf4-a32ab09d5a02 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:38.664298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b6dd503b-92fb-4fc2-abf4-a32ab09d5a02 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:38.664770 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b6dd503b-92fb-4fc2-abf4-a32ab09d5a02 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:38.665455 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b6dd503b-92fb-4fc2-abf4-a32ab09d5a02 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:38.665905 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b6dd503b-92fb-4fc2-abf4-a32ab09d5a02 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:38.666336 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b6dd503b-92fb-4fc2-abf4-a32ab09d5a02 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:38.800974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b6dd503b-92fb-4fc2-abf4-a32ab09d5a02 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:38.808869 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b6dd503b-92fb-4fc2-abf4-a32ab09d5a02 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.159342 Sep 15 13:01:38.809447 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 157/309] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:38 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:01:39.831280 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f5013334-b62d-4b55-a6e0-063a9f0d04b4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:39.832016 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f5013334-b62d-4b55-a6e0-063a9f0d04b4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:39.838168 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5013334-b62d-4b55-a6e0-063a9f0d04b4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:39.838652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5013334-b62d-4b55-a6e0-063a9f0d04b4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:39.839087 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5013334-b62d-4b55-a6e0-063a9f0d04b4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:39.839802 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5013334-b62d-4b55-a6e0-063a9f0d04b4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:39.840312 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5013334-b62d-4b55-a6e0-063a9f0d04b4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:39.840875 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5013334-b62d-4b55-a6e0-063a9f0d04b4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:40.127415 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f5013334-b62d-4b55-a6e0-063a9f0d04b4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:40.135138 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f5013334-b62d-4b55-a6e0-063a9f0d04b4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.307786 Sep 15 13:01:40.135707 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 153/310] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:39 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:41.159896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3e79c985-4a0c-4d4c-817f-055a2439f3b6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:41.161527 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3e79c985-4a0c-4d4c-817f-055a2439f3b6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:41.171292 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3e79c985-4a0c-4d4c-817f-055a2439f3b6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:41.171872 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3e79c985-4a0c-4d4c-817f-055a2439f3b6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:41.172406 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3e79c985-4a0c-4d4c-817f-055a2439f3b6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:41.173172 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3e79c985-4a0c-4d4c-817f-055a2439f3b6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:41.173690 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3e79c985-4a0c-4d4c-817f-055a2439f3b6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:41.174207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3e79c985-4a0c-4d4c-817f-055a2439f3b6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:41.318713 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3e79c985-4a0c-4d4c-817f-055a2439f3b6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:41.326745 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3e79c985-4a0c-4d4c-817f-055a2439f3b6 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.171922 Sep 15 13:01:41.327318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 158/311] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:41 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:42.349183 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8d9bd569-1af9-45d2-82e2-c745f47c5c76 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:42.349741 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8d9bd569-1af9-45d2-82e2-c745f47c5c76 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:42.355635 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8d9bd569-1af9-45d2-82e2-c745f47c5c76 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:42.356115 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8d9bd569-1af9-45d2-82e2-c745f47c5c76 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:42.356583 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8d9bd569-1af9-45d2-82e2-c745f47c5c76 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:42.357266 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8d9bd569-1af9-45d2-82e2-c745f47c5c76 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:42.357716 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8d9bd569-1af9-45d2-82e2-c745f47c5c76 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:42.358134 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8d9bd569-1af9-45d2-82e2-c745f47c5c76 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:42.489900 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8d9bd569-1af9-45d2-82e2-c745f47c5c76 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:42.498341 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8d9bd569-1af9-45d2-82e2-c745f47c5c76 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.153189 Sep 15 13:01:42.498897 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 154/312] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:42 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:43.522010 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f038f1a1-0822-44f2-bd09-4beb510f0be9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:43.522647 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f038f1a1-0822-44f2-bd09-4beb510f0be9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:43.530077 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f038f1a1-0822-44f2-bd09-4beb510f0be9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:43.530562 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f038f1a1-0822-44f2-bd09-4beb510f0be9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:43.530998 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f038f1a1-0822-44f2-bd09-4beb510f0be9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:43.531691 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f038f1a1-0822-44f2-bd09-4beb510f0be9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:43.532144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f038f1a1-0822-44f2-bd09-4beb510f0be9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:43.532599 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f038f1a1-0822-44f2-bd09-4beb510f0be9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:43.660776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f038f1a1-0822-44f2-bd09-4beb510f0be9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:43.669260 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f038f1a1-0822-44f2-bd09-4beb510f0be9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.151401 Sep 15 13:01:43.669831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 159/313] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:43 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:44.691742 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-9529542f-679c-48df-a45b-469f7547e1fb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:44.692324 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-9529542f-679c-48df-a45b-469f7547e1fb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:44.698410 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9529542f-679c-48df-a45b-469f7547e1fb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:44.698891 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9529542f-679c-48df-a45b-469f7547e1fb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:44.699325 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9529542f-679c-48df-a45b-469f7547e1fb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:44.700003 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9529542f-679c-48df-a45b-469f7547e1fb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:44.700486 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9529542f-679c-48df-a45b-469f7547e1fb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:44.700904 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9529542f-679c-48df-a45b-469f7547e1fb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:44.827820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9529542f-679c-48df-a45b-469f7547e1fb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:44.835454 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-9529542f-679c-48df-a45b-469f7547e1fb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.147616 Sep 15 13:01:44.836010 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 155/314] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:44 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:45.858941 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-77d57933-4289-4113-9b24-72bd12e399d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:45.859540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-77d57933-4289-4113-9b24-72bd12e399d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:45.865999 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-77d57933-4289-4113-9b24-72bd12e399d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:45.866476 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-77d57933-4289-4113-9b24-72bd12e399d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:45.866910 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-77d57933-4289-4113-9b24-72bd12e399d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:45.867584 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-77d57933-4289-4113-9b24-72bd12e399d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:45.868027 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-77d57933-4289-4113-9b24-72bd12e399d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:45.868590 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-77d57933-4289-4113-9b24-72bd12e399d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:45.999832 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-77d57933-4289-4113-9b24-72bd12e399d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:46.007567 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-77d57933-4289-4113-9b24-72bd12e399d0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.152876 Sep 15 13:01:46.008132 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 160/315] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:45 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:47.030698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5e7a45a1-743f-4696-b2d5-b37371d01e7f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:47.031304 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5e7a45a1-743f-4696-b2d5-b37371d01e7f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:47.037128 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5e7a45a1-743f-4696-b2d5-b37371d01e7f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:47.037604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5e7a45a1-743f-4696-b2d5-b37371d01e7f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:47.038027 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5e7a45a1-743f-4696-b2d5-b37371d01e7f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:47.038702 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5e7a45a1-743f-4696-b2d5-b37371d01e7f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:47.039145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5e7a45a1-743f-4696-b2d5-b37371d01e7f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:47.039557 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5e7a45a1-743f-4696-b2d5-b37371d01e7f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:47.169823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5e7a45a1-743f-4696-b2d5-b37371d01e7f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:47.177345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5e7a45a1-743f-4696-b2d5-b37371d01e7f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.150613 Sep 15 13:01:47.177937 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 156/316] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:47 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:47.400062 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-ff7936b8-9ee5-48cc-9c1d-4199a1c16c46 req-f5ded403-a7fd-4cdc-87e5-a78144ce0082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4ff8111-8ab2-4e8d-8278-f76f69b76196", "name": "network-vif-plugged", "status": "completed", "tag": "de279c4f-9053-44d1-aa49-aa402574c2ed"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:01:47.415634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-ff7936b8-9ee5-48cc-9c1d-4199a1c16c46 req-f5ded403-a7fd-4cdc-87e5-a78144ce0082 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:47.416211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-ff7936b8-9ee5-48cc-9c1d-4199a1c16c46 req-f5ded403-a7fd-4cdc-87e5-a78144ce0082 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:47.416669 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-ff7936b8-9ee5-48cc-9c1d-4199a1c16c46 req-f5ded403-a7fd-4cdc-87e5-a78144ce0082 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:47.429214 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-ff7936b8-9ee5-48cc-9c1d-4199a1c16c46 req-f5ded403-a7fd-4cdc-87e5-a78144ce0082 service nova] Creating event network-vif-plugged:de279c4f-9053-44d1-aa49-aa402574c2ed for instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 on hv-cinder-83608 Sep 15 13:01:47.435565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-ff7936b8-9ee5-48cc-9c1d-4199a1c16c46 req-f5ded403-a7fd-4cdc-87e5-a78144ce0082 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042840 Sep 15 13:01:47.436633 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 161/317] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:01:48.201141 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-40da1337-eaef-4dea-b397-eb57e7f79464 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:48.201961 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-40da1337-eaef-4dea-b397-eb57e7f79464 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:48.208089 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-40da1337-eaef-4dea-b397-eb57e7f79464 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:48.208602 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-40da1337-eaef-4dea-b397-eb57e7f79464 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:48.209028 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-40da1337-eaef-4dea-b397-eb57e7f79464 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:48.209711 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-40da1337-eaef-4dea-b397-eb57e7f79464 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:48.210152 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-40da1337-eaef-4dea-b397-eb57e7f79464 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:48.210566 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-40da1337-eaef-4dea-b397-eb57e7f79464 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:48.344447 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-40da1337-eaef-4dea-b397-eb57e7f79464 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:48.352438 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-40da1337-eaef-4dea-b397-eb57e7f79464 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.155579 Sep 15 13:01:48.353015 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 157/318] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:48 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:01:49.376632 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-34c777ee-c446-426c-aec3-c848203034d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:49.377331 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-34c777ee-c446-426c-aec3-c848203034d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:49.384570 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-34c777ee-c446-426c-aec3-c848203034d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:49.385139 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-34c777ee-c446-426c-aec3-c848203034d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:49.385567 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-34c777ee-c446-426c-aec3-c848203034d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:49.386391 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-34c777ee-c446-426c-aec3-c848203034d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:49.387008 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-34c777ee-c446-426c-aec3-c848203034d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:49.388157 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-34c777ee-c446-426c-aec3-c848203034d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:49.529470 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-34c777ee-c446-426c-aec3-c848203034d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:49.537192 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-34c777ee-c446-426c-aec3-c848203034d9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1371 microversion: 2.1 time: 0.165957 Sep 15 13:01:49.537860 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 162/319] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:49 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:50.563359 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b0c5d265-f82d-437d-8083-27d99e534262 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:50.564024 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b0c5d265-f82d-437d-8083-27d99e534262 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:50.572678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b0c5d265-f82d-437d-8083-27d99e534262 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:50.573162 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b0c5d265-f82d-437d-8083-27d99e534262 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:50.573590 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b0c5d265-f82d-437d-8083-27d99e534262 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:50.574282 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b0c5d265-f82d-437d-8083-27d99e534262 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:50.574730 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b0c5d265-f82d-437d-8083-27d99e534262 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:50.575141 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b0c5d265-f82d-437d-8083-27d99e534262 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:50.709207 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b0c5d265-f82d-437d-8083-27d99e534262 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:01:50.717760 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b0c5d265-f82d-437d-8083-27d99e534262 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1565 microversion: 2.1 time: 0.160665 Sep 15 13:01:50.718335 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 158/320] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:01:50 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:01:50.740913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e03b835a-4128-43ae-91eb-bdf551bb8e94 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:01:50.741405 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e03b835a-4128-43ae-91eb-bdf551bb8e94 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:01:50.748550 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e03b835a-4128-43ae-91eb-bdf551bb8e94 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:50.749048 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e03b835a-4128-43ae-91eb-bdf551bb8e94 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:50.749479 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e03b835a-4128-43ae-91eb-bdf551bb8e94 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:50.750172 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e03b835a-4128-43ae-91eb-bdf551bb8e94 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:50.750619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e03b835a-4128-43ae-91eb-bdf551bb8e94 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:50.751034 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e03b835a-4128-43ae-91eb-bdf551bb8e94 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:50.833975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e03b835a-4128-43ae-91eb-bdf551bb8e94 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097062 Sep 15 13:01:50.834792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 163/321] 10.222.0.57 () {58 vars in 1275 bytes} [Thu Sep 15 13:01:50 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:01:51.826255 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-3108551a-e40b-4574-927b-a2919191f3db req-04cb73f0-a429-4d53-89a6-0bad42964213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4ff8111-8ab2-4e8d-8278-f76f69b76196", "tag": "de279c4f-9053-44d1-aa49-aa402574c2ed"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:01:51.836437 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-3108551a-e40b-4574-927b-a2919191f3db req-04cb73f0-a429-4d53-89a6-0bad42964213 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:01:51.837070 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-3108551a-e40b-4574-927b-a2919191f3db req-04cb73f0-a429-4d53-89a6-0bad42964213 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:01:51.837730 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-3108551a-e40b-4574-927b-a2919191f3db req-04cb73f0-a429-4d53-89a6-0bad42964213 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:01:51.842010 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=86 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:51.851611 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-3108551a-e40b-4574-927b-a2919191f3db req-04cb73f0-a429-4d53-89a6-0bad42964213 service nova] Creating event network-changed:de279c4f-9053-44d1-aa49-aa402574c2ed for instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 on hv-cinder-83608 Sep 15 13:01:51.859129 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-3108551a-e40b-4574-927b-a2919191f3db req-04cb73f0-a429-4d53-89a6-0bad42964213 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037561 Sep 15 13:01:51.860333 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 159/322] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:02:13.649969 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=13 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:13.650710 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=74 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:13.651777 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 13:02:13.651959 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Thu Sep 15 13:02:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.57) !!! Sep 15 13:02:13.832863 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b1d8761f-9d8b-4d34-be97-e3f2b904bbb8 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Action: 'create', calling method: .version_select at 0x7f62c56b61f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1061091117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAFWuynfmybDLJimBsafLrFOhyfhWFpMVTI+dhV9/ILhXtST+Fo1Q4La6NgX4gytusTQqUXudYdezSSbWyaA1QDYXGi3/IGag0dHY1VvyBKZynlyNQRcJVww/IE3bfIZQ=="}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:02:13.849398 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-b1d8761f-9d8b-4d34-be97-e3f2b904bbb8 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Getting quotas for project a6537f34327448c2b6acd5774dffc8c9. Resources: {'key_pairs'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:02:13.853481 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-b1d8761f-9d8b-4d34-be97-e3f2b904bbb8 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Getting quotas for user 381e3962c4e24a599e720303e9be17e2 and project a6537f34327448c2b6acd5774dffc8c9. Resources: {'key_pairs'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:02:13.878433 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b1d8761f-9d8b-4d34-be97-e3f2b904bbb8 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.229890 Sep 15 13:02:13.879513 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 164/323] 10.222.0.57 () {60 vars in 1159 bytes} [Thu Sep 15 13:02:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:02:27.584434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3d6c63c1-827f-4f66-9b8f-80147a7197a4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:27.585009 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3d6c63c1-827f-4f66-9b8f-80147a7197a4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:27.587477 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 13:02:27.587622 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Thu Sep 15 13:02:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8/ips (ip 10.222.0.57) !!! Sep 15 13:02:27.589411 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=21 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:27.590054 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:27.603045 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3d6c63c1-827f-4f66-9b8f-80147a7197a4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:27.603521 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3d6c63c1-827f-4f66-9b8f-80147a7197a4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:27.603947 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3d6c63c1-827f-4f66-9b8f-80147a7197a4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:27.604658 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3d6c63c1-827f-4f66-9b8f-80147a7197a4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:27.605103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3d6c63c1-827f-4f66-9b8f-80147a7197a4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:27.605517 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3d6c63c1-827f-4f66-9b8f-80147a7197a4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:27.631098 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3d6c63c1-827f-4f66-9b8f-80147a7197a4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8/ips" status: 200 len: 150 microversion: 2.1 time: 0.050859 Sep 15 13:02:27.631586 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 160/324] 10.222.0.57 () {58 vars in 1248 bytes} [Thu Sep 15 13:02:27 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:02:30.057509 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=4 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:30.058445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:30.063068 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-82103855-6ae5-4014-a644-42c360a1e811 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "159f754b-7c48-4a32-a015-cf79360e219c"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:02:30.065425 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-82103855-6ae5-4014-a644-42c360a1e811 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:30.072497 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-82103855-6ae5-4014-a644-42c360a1e811 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:30.072967 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-82103855-6ae5-4014-a644-42c360a1e811 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:30.073390 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-82103855-6ae5-4014-a644-42c360a1e811 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:30.074068 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-82103855-6ae5-4014-a644-42c360a1e811 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:30.074515 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-82103855-6ae5-4014-a644-42c360a1e811 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:30.074928 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-82103855-6ae5-4014-a644-42c360a1e811 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:30.373987 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-82103855-6ae5-4014-a644-42c360a1e811 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "POST /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316818 Sep 15 13:02:30.374582 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 165/325] 10.222.0.57 () {60 vars in 1323 bytes} [Thu Sep 15 13:02:30 2022] POST /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:02:31.657064 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1a1a931a-4119-4217-9ab7-fc1131f8c4c9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:31.657595 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1a1a931a-4119-4217-9ab7-fc1131f8c4c9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:31.663456 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a1a931a-4119-4217-9ab7-fc1131f8c4c9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:31.663937 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a1a931a-4119-4217-9ab7-fc1131f8c4c9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:31.664536 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a1a931a-4119-4217-9ab7-fc1131f8c4c9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:31.665228 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a1a931a-4119-4217-9ab7-fc1131f8c4c9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:31.665682 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a1a931a-4119-4217-9ab7-fc1131f8c4c9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:31.666106 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a1a931a-4119-4217-9ab7-fc1131f8c4c9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:31.689295 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1a1a931a-4119-4217-9ab7-fc1131f8c4c9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/ips" status: 200 len: 143 microversion: 2.1 time: 0.036835 Sep 15 13:02:31.689849 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 161/326] 10.222.0.57 () {58 vars in 1248 bytes} [Thu Sep 15 13:02:31 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/ips => generated 143 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:02:35.722528 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5bd7b911-0f58-4fdf-ac82-68256eb21c38 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3025f169-aa09-46af-8598-fe9bae59d402"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:02:35.725116 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-5bd7b911-0f58-4fdf-ac82-68256eb21c38 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:35.731242 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5bd7b911-0f58-4fdf-ac82-68256eb21c38 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:35.731719 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5bd7b911-0f58-4fdf-ac82-68256eb21c38 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:35.732147 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5bd7b911-0f58-4fdf-ac82-68256eb21c38 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:35.732928 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5bd7b911-0f58-4fdf-ac82-68256eb21c38 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:35.733392 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5bd7b911-0f58-4fdf-ac82-68256eb21c38 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:35.733973 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5bd7b911-0f58-4fdf-ac82-68256eb21c38 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:36.035912 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-5bd7b911-0f58-4fdf-ac82-68256eb21c38 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "POST /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318907 Sep 15 13:02:36.036675 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 166/327] 10.222.0.57 () {60 vars in 1323 bytes} [Thu Sep 15 13:02:35 2022] POST /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:02:36.603680 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-12f408cc-c0d6-4805-9ec9-97f4e24790cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:36.604243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-12f408cc-c0d6-4805-9ec9-97f4e24790cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:36.610532 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-12f408cc-c0d6-4805-9ec9-97f4e24790cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:36.611019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-12f408cc-c0d6-4805-9ec9-97f4e24790cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:36.611465 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-12f408cc-c0d6-4805-9ec9-97f4e24790cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:36.612147 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-12f408cc-c0d6-4805-9ec9-97f4e24790cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:36.612630 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-12f408cc-c0d6-4805-9ec9-97f4e24790cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:36.613058 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-12f408cc-c0d6-4805-9ec9-97f4e24790cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:36.635526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-12f408cc-c0d6-4805-9ec9-97f4e24790cf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/ips" status: 200 len: 152 microversion: 2.20 time: 0.035798 Sep 15 13:02:36.636077 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 162/328] 10.222.0.57 () {60 vars in 1289 bytes} [Thu Sep 15 13:02:36 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 13:02:38.990293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e4636c17-2fd7-4fdc-ab21-e9a27ef9fc2d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Action: 'create', calling method: .version_select at 0x7f62c57a8790>, body: {"keypair": {"name": "tempest-keypair-43585664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNstggZB0POsplYMwPl5cYzBNG9JkxKlXPmo6rr3cH2gUV1t36Ww3YiDyovRf96Z0mABdyH4oVxEw0G9raclyeRwOIbXDtVTiEud9DXNvE3hjZarWul5ioEDEx6m/oel9w=="}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:02:39.006706 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-e4636c17-2fd7-4fdc-ab21-e9a27ef9fc2d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'key_pairs'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:02:39.010530 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-e4636c17-2fd7-4fdc-ab21-e9a27ef9fc2d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for user cd22d2df9ced4bb0961596385854422d and project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'key_pairs'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:02:39.034623 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e4636c17-2fd7-4fdc-ab21-e9a27ef9fc2d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.050440 Sep 15 13:02:39.035294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 167/329] 10.222.0.57 () {60 vars in 1159 bytes} [Thu Sep 15 13:02:38 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:02:39.571235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0929361b-b45e-4583-8836-0eb22fa910c8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:02:39.572327 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0929361b-b45e-4583-8836-0eb22fa910c8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:39.581190 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0929361b-b45e-4583-8836-0eb22fa910c8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:39.581703 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0929361b-b45e-4583-8836-0eb22fa910c8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:39.582425 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0929361b-b45e-4583-8836-0eb22fa910c8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:39.583566 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0929361b-b45e-4583-8836-0eb22fa910c8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:39.584352 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0929361b-b45e-4583-8836-0eb22fa910c8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:39.585117 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0929361b-b45e-4583-8836-0eb22fa910c8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:39.613691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-0929361b-b45e-4583-8836-0eb22fa910c8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lazy-loading 'flavor' on Instance uuid 1777381a-01af-43ba-98dc-31bfeeded7bb {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:02:39.847087 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0929361b-b45e-4583-8836-0eb22fa910c8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "POST /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/action" status: 202 len: 0 microversion: 2.20 time: 0.280276 Sep 15 13:02:39.847692 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 163/330] 10.222.0.57 () {62 vars in 1319 bytes} [Thu Sep 15 13:02:39 2022] POST /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 15 13:02:39.856195 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f8ae3712-4bbb-47f9-8919-bf4667db7713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:39.857071 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f8ae3712-4bbb-47f9-8919-bf4667db7713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:39.867097 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3712-4bbb-47f9-8919-bf4667db7713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:39.867593 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3712-4bbb-47f9-8919-bf4667db7713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:39.868041 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3712-4bbb-47f9-8919-bf4667db7713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:39.868829 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3712-4bbb-47f9-8919-bf4667db7713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:39.869295 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3712-4bbb-47f9-8919-bf4667db7713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:39.869715 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3712-4bbb-47f9-8919-bf4667db7713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:40.095988 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f8ae3712-4bbb-47f9-8919-bf4667db7713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:40.107998 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f8ae3712-4bbb-47f9-8919-bf4667db7713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:40.110959 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f8ae3712-4bbb-47f9-8919-bf4667db7713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:40.112155 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f8ae3712-4bbb-47f9-8919-bf4667db7713 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1724 microversion: 2.20 time: 0.260093 Sep 15 13:02:40.132303 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 168/331] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:39 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:40.746495 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-545130292", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0e4d116-b42c-4d92-83e5-69793b91ec95"}], "security_groups": [{"name": "tempest-securitygroup--1322677581"}], "key_name": "tempest-keypair-43585664", "user_data": "}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:02:40.851140 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.network.neutron [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] validate_networks() for [('e0e4d116-b42c-4d92-83e5-69793b91ec95', None, None, None, None, None)] {{(pid=120634) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:02:40.851297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1727768019", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1061091117", "security_groups": [{"name": "tempest-secgroup-smoke-2072601554"}], "networks": [{"uuid": "7a66741c-7788-4977-a625-7b1bd1896edc"}], "block_device_mapping_v2": [{"uuid": "46b23e40-b931-4b59-a887-1f7b0f821b21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:02:40.966953 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.network.neutron [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] validate_networks() for [('7a66741c-7788-4977-a625-7b1bd1896edc', None, None, None, None, None)] {{(pid=120633) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:02:41.238252 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Flavor limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:02:41.238671 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Image limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:02:41.239172 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Flavor pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:02:41.239576 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Image pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:02:41.239978 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:02:41.248829 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:41.249436 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:41.249919 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:41.250643 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:41.251095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:41.251512 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:41.270942 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:02:41.274829 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for user cd22d2df9ced4bb0961596385854422d and project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:02:41.286648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Going to run 1 instances... {{(pid=120634) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:02:41.289048 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120634) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:02:41.337392 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0e2a20ba-001f-4f9b-90fc-2817596a8753 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.595390 Sep 15 13:02:41.337910 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 164/332] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:02:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 13:02:41.339892 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Flavor limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:02:41.341053 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Image limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:02:41.341743 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Flavor pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:02:41.342377 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Image pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:02:41.343167 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:02:41.349545 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-37584a4e-e581-43f2-ac26-f3df30a08b0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:41.350150 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-37584a4e-e581-43f2-ac26-f3df30a08b0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:41.354571 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:41.355374 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:41.356181 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:41.356514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-37584a4e-e581-43f2-ac26-f3df30a08b0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:41.357000 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-37584a4e-e581-43f2-ac26-f3df30a08b0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:41.357439 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-37584a4e-e581-43f2-ac26-f3df30a08b0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:41.358134 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-37584a4e-e581-43f2-ac26-f3df30a08b0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:41.358495 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:41.359165 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-37584a4e-e581-43f2-ac26-f3df30a08b0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:41.359580 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-37584a4e-e581-43f2-ac26-f3df30a08b0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:41.360194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:41.360898 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:41.406474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Getting quotas for project a6537f34327448c2b6acd5774dffc8c9. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:02:41.412222 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Getting quotas for user 381e3962c4e24a599e720303e9be17e2 and project a6537f34327448c2b6acd5774dffc8c9. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:02:41.493903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Going to run 1 instances... {{(pid=120633) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:02:41.496033 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46b23e40-b931-4b59-a887-1f7b0f821b21',volume_size=None,volume_type=None)] {{(pid=120633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:02:41.643095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-37584a4e-e581-43f2-ac26-f3df30a08b0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:41.652451 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-37584a4e-e581-43f2-ac26-f3df30a08b0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:41.653924 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-37584a4e-e581-43f2-ac26-f3df30a08b0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:41.655155 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-37584a4e-e581-43f2-ac26-f3df30a08b0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1724 microversion: 2.20 time: 0.309495 Sep 15 13:02:41.656502 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2dd11ec9-1584-40db-b550-701347fa1dcf tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.808543 Sep 15 13:02:41.672175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 165/333] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:41 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:41.672175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-df91f3a9-782e-41f2-85cc-1cd2c9c9c6d2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:41.672175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-df91f3a9-782e-41f2-85cc-1cd2c9c9c6d2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:41.672569 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 169/334] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:02:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 13:02:41.672569 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7bd269d5-3fe5-4268-8ff2-d6f576095988 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:41.672569 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7bd269d5-3fe5-4268-8ff2-d6f576095988 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:41.728809 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7bd269d5-3fe5-4268-8ff2-d6f576095988 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:41.737944 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7bd269d5-3fe5-4268-8ff2-d6f576095988 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1089 microversion: 2.1 time: 0.073071 Sep 15 13:02:41.739862 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 170/335] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:41 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:41.748467 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-df91f3a9-782e-41f2-85cc-1cd2c9c9c6d2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:41.756648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-df91f3a9-782e-41f2-85cc-1cd2c9c9c6d2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1239 microversion: 2.1 time: 0.098753 Sep 15 13:02:41.757295 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 166/336] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:41 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1239 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:42.681187 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ff32ed09-aac7-4d5b-a06f-004a28f501d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:42.681724 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ff32ed09-aac7-4d5b-a06f-004a28f501d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:42.689306 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff32ed09-aac7-4d5b-a06f-004a28f501d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:42.689788 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff32ed09-aac7-4d5b-a06f-004a28f501d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:42.690218 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff32ed09-aac7-4d5b-a06f-004a28f501d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:42.690911 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff32ed09-aac7-4d5b-a06f-004a28f501d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:42.691357 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff32ed09-aac7-4d5b-a06f-004a28f501d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:42.691779 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff32ed09-aac7-4d5b-a06f-004a28f501d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:42.763573 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-feb41189-4ca2-4b1d-a062-ac2ec7402c7a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:42.764248 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-feb41189-4ca2-4b1d-a062-ac2ec7402c7a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:42.776846 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-feb41189-4ca2-4b1d-a062-ac2ec7402c7a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:42.777333 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-feb41189-4ca2-4b1d-a062-ac2ec7402c7a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:42.777798 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-feb41189-4ca2-4b1d-a062-ac2ec7402c7a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:42.778494 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-feb41189-4ca2-4b1d-a062-ac2ec7402c7a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:42.778968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-feb41189-4ca2-4b1d-a062-ac2ec7402c7a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:42.779383 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-feb41189-4ca2-4b1d-a062-ac2ec7402c7a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:42.833839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ff32ed09-aac7-4d5b-a06f-004a28f501d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:42.845004 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ff32ed09-aac7-4d5b-a06f-004a28f501d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:42.846705 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ff32ed09-aac7-4d5b-a06f-004a28f501d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:42.848032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ff32ed09-aac7-4d5b-a06f-004a28f501d5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1724 microversion: 2.20 time: 0.170847 Sep 15 13:02:42.849490 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 171/337] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:42 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:42.854479 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5ee032d2-887b-461d-9b0a-1fd67bd3d398 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:42.855272 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-5ee032d2-887b-461d-9b0a-1fd67bd3d398 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:42.865151 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-feb41189-4ca2-4b1d-a062-ac2ec7402c7a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:42.872254 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5ee032d2-887b-461d-9b0a-1fd67bd3d398 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:42.873238 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5ee032d2-887b-461d-9b0a-1fd67bd3d398 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:42.873671 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5ee032d2-887b-461d-9b0a-1fd67bd3d398 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:42.873848 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-feb41189-4ca2-4b1d-a062-ac2ec7402c7a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1131 microversion: 2.1 time: 0.113990 Sep 15 13:02:42.874702 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 167/338] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:42 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1131 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:02:42.894769 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5ee032d2-887b-461d-9b0a-1fd67bd3d398 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:42.895577 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5ee032d2-887b-461d-9b0a-1fd67bd3d398 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:42.896034 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5ee032d2-887b-461d-9b0a-1fd67bd3d398 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:42.976511 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-5ee032d2-887b-461d-9b0a-1fd67bd3d398 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:42.984852 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-5ee032d2-887b-461d-9b0a-1fd67bd3d398 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1299 microversion: 2.1 time: 0.133862 Sep 15 13:02:43.004330 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 172/339] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:42 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:43.874855 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f5fd95f1-4ddb-4f16-a88c-1f401018642b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:43.875471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f5fd95f1-4ddb-4f16-a88c-1f401018642b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:43.881361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5fd95f1-4ddb-4f16-a88c-1f401018642b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:43.881873 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5fd95f1-4ddb-4f16-a88c-1f401018642b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:43.882304 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5fd95f1-4ddb-4f16-a88c-1f401018642b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:43.883000 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5fd95f1-4ddb-4f16-a88c-1f401018642b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:43.883448 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5fd95f1-4ddb-4f16-a88c-1f401018642b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:43.883890 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f5fd95f1-4ddb-4f16-a88c-1f401018642b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:43.900566 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e6c7e982-ae4b-4549-8c20-d932e8a6ee4a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:43.901176 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e6c7e982-ae4b-4549-8c20-d932e8a6ee4a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:43.908466 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e6c7e982-ae4b-4549-8c20-d932e8a6ee4a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:43.908949 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e6c7e982-ae4b-4549-8c20-d932e8a6ee4a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:43.909406 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e6c7e982-ae4b-4549-8c20-d932e8a6ee4a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:43.910276 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e6c7e982-ae4b-4549-8c20-d932e8a6ee4a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:43.910729 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e6c7e982-ae4b-4549-8c20-d932e8a6ee4a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:43.911146 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e6c7e982-ae4b-4549-8c20-d932e8a6ee4a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:43.979568 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e6c7e982-ae4b-4549-8c20-d932e8a6ee4a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:43.988061 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e6c7e982-ae4b-4549-8c20-d932e8a6ee4a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1205 microversion: 2.1 time: 0.091619 Sep 15 13:02:43.989232 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 173/340] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:43 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1205 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:02:44.022412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ad41a944-8420-44bc-b866-f1ad1998611a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:44.028573 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ad41a944-8420-44bc-b866-f1ad1998611a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:44.035155 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ad41a944-8420-44bc-b866-f1ad1998611a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:44.035839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ad41a944-8420-44bc-b866-f1ad1998611a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:44.036481 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ad41a944-8420-44bc-b866-f1ad1998611a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:44.037362 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ad41a944-8420-44bc-b866-f1ad1998611a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:44.038101 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ad41a944-8420-44bc-b866-f1ad1998611a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:44.038677 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ad41a944-8420-44bc-b866-f1ad1998611a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:44.175394 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ad41a944-8420-44bc-b866-f1ad1998611a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:44.183144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ad41a944-8420-44bc-b866-f1ad1998611a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1365 microversion: 2.1 time: 0.164813 Sep 15 13:02:44.184552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 174/341] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:44 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:02:44.240766 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f5fd95f1-4ddb-4f16-a88c-1f401018642b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:44.251049 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f5fd95f1-4ddb-4f16-a88c-1f401018642b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:44.253017 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f5fd95f1-4ddb-4f16-a88c-1f401018642b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:44.254360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f5fd95f1-4ddb-4f16-a88c-1f401018642b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1724 microversion: 2.20 time: 0.383569 Sep 15 13:02:44.255214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 168/342] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:43 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1724 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:44.912543 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-e3a4b7a4-efe9-4ca1-aab2-9101fc237b6b req-a34962ba-53f8-442a-bb07-70b1d059e37b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5170c49a-0d2d-487f-abc1-2cc80ebb31b4", "tag": "a40c3efd-d157-4cf4-9c28-2e3f09f142e7"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:02:44.923765 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e3a4b7a4-efe9-4ca1-aab2-9101fc237b6b req-a34962ba-53f8-442a-bb07-70b1d059e37b service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:44.924698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e3a4b7a4-efe9-4ca1-aab2-9101fc237b6b req-a34962ba-53f8-442a-bb07-70b1d059e37b service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:44.925240 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e3a4b7a4-efe9-4ca1-aab2-9101fc237b6b req-a34962ba-53f8-442a-bb07-70b1d059e37b service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:44.938628 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-e3a4b7a4-efe9-4ca1-aab2-9101fc237b6b req-a34962ba-53f8-442a-bb07-70b1d059e37b service nova] Creating event network-changed:a40c3efd-d157-4cf4-9c28-2e3f09f142e7 for instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 on hv-cinder-83608 Sep 15 13:02:44.944582 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-e3a4b7a4-efe9-4ca1-aab2-9101fc237b6b req-a34962ba-53f8-442a-bb07-70b1d059e37b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035578 Sep 15 13:02:44.945746 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 175/343] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:02:45.018958 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ae43a257-b0ca-405a-affc-eb189218ba88 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:45.019571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ae43a257-b0ca-405a-affc-eb189218ba88 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:45.037400 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ae43a257-b0ca-405a-affc-eb189218ba88 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:45.038238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ae43a257-b0ca-405a-affc-eb189218ba88 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:45.038932 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ae43a257-b0ca-405a-affc-eb189218ba88 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:45.039906 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ae43a257-b0ca-405a-affc-eb189218ba88 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:45.042186 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ae43a257-b0ca-405a-affc-eb189218ba88 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:45.042703 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ae43a257-b0ca-405a-affc-eb189218ba88 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:45.208231 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-511ffe59-0148-4d1f-ba5d-1188b747cd1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:45.208965 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-511ffe59-0148-4d1f-ba5d-1188b747cd1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:45.215277 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-511ffe59-0148-4d1f-ba5d-1188b747cd1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:45.215756 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-511ffe59-0148-4d1f-ba5d-1188b747cd1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:45.216185 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-511ffe59-0148-4d1f-ba5d-1188b747cd1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:45.216911 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-511ffe59-0148-4d1f-ba5d-1188b747cd1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:45.217357 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-511ffe59-0148-4d1f-ba5d-1188b747cd1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:45.217770 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-511ffe59-0148-4d1f-ba5d-1188b747cd1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:45.281959 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ae43a257-b0ca-405a-affc-eb189218ba88 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:45.295652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ae43a257-b0ca-405a-affc-eb189218ba88 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1273 microversion: 2.1 time: 0.288172 Sep 15 13:02:45.309093 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 169/344] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:45 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1273 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:45.315228 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2a5eb4ad-0250-4a53-b42f-3eed777398df tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:45.315945 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2a5eb4ad-0250-4a53-b42f-3eed777398df tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:45.325375 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2a5eb4ad-0250-4a53-b42f-3eed777398df tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:45.325868 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2a5eb4ad-0250-4a53-b42f-3eed777398df tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:45.326301 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2a5eb4ad-0250-4a53-b42f-3eed777398df tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:45.327003 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2a5eb4ad-0250-4a53-b42f-3eed777398df tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:45.328504 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2a5eb4ad-0250-4a53-b42f-3eed777398df tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:45.328992 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2a5eb4ad-0250-4a53-b42f-3eed777398df tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:45.364115 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-511ffe59-0148-4d1f-ba5d-1188b747cd1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:45.371659 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-511ffe59-0148-4d1f-ba5d-1188b747cd1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1365 microversion: 2.1 time: 0.168979 Sep 15 13:02:45.372213 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 176/345] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:45 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:02:45.557171 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2a5eb4ad-0250-4a53-b42f-3eed777398df tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:45.565902 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2a5eb4ad-0250-4a53-b42f-3eed777398df tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:45.567333 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2a5eb4ad-0250-4a53-b42f-3eed777398df tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:45.569450 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2a5eb4ad-0250-4a53-b42f-3eed777398df tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1724 microversion: 2.20 time: 0.258302 Sep 15 13:02:45.580512 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 170/346] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:45 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:46.320897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d68c39ec-a3fa-4c1a-a2e6-34656e976144 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:46.321609 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d68c39ec-a3fa-4c1a-a2e6-34656e976144 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:46.329040 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d68c39ec-a3fa-4c1a-a2e6-34656e976144 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:46.329591 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d68c39ec-a3fa-4c1a-a2e6-34656e976144 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:46.330038 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d68c39ec-a3fa-4c1a-a2e6-34656e976144 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:46.330797 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d68c39ec-a3fa-4c1a-a2e6-34656e976144 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:46.331288 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d68c39ec-a3fa-4c1a-a2e6-34656e976144 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:46.331744 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d68c39ec-a3fa-4c1a-a2e6-34656e976144 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:46.396003 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-30c56225-7402-4ac7-b13b-539821ea38c7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:46.396791 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-30c56225-7402-4ac7-b13b-539821ea38c7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:46.412886 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30c56225-7402-4ac7-b13b-539821ea38c7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:46.413666 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30c56225-7402-4ac7-b13b-539821ea38c7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:46.414108 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30c56225-7402-4ac7-b13b-539821ea38c7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:46.414833 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30c56225-7402-4ac7-b13b-539821ea38c7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:46.415466 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30c56225-7402-4ac7-b13b-539821ea38c7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:46.416006 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30c56225-7402-4ac7-b13b-539821ea38c7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:46.516790 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d68c39ec-a3fa-4c1a-a2e6-34656e976144 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:46.525342 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d68c39ec-a3fa-4c1a-a2e6-34656e976144 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1273 microversion: 2.1 time: 0.208248 Sep 15 13:02:46.525926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 177/347] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:46 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1273 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:46.596650 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9635cdf1-860a-43d9-a416-d06650d11afc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:46.597261 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9635cdf1-860a-43d9-a416-d06650d11afc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:46.603114 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9635cdf1-860a-43d9-a416-d06650d11afc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:46.603597 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9635cdf1-860a-43d9-a416-d06650d11afc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:46.604029 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9635cdf1-860a-43d9-a416-d06650d11afc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:46.604743 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9635cdf1-860a-43d9-a416-d06650d11afc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:46.605195 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9635cdf1-860a-43d9-a416-d06650d11afc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:46.605612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9635cdf1-860a-43d9-a416-d06650d11afc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:46.741602 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9635cdf1-860a-43d9-a416-d06650d11afc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:46.750295 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9635cdf1-860a-43d9-a416-d06650d11afc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:46.751741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9635cdf1-860a-43d9-a416-d06650d11afc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:46.753076 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9635cdf1-860a-43d9-a416-d06650d11afc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1724 microversion: 2.20 time: 0.160532 Sep 15 13:02:46.753628 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 178/348] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:46 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:02:46.809607 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7b0c5176-ebf6-4f67-8671-a2d2f93b3001 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:02:46.816604 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7b0c5176-ebf6-4f67-8671-a2d2f93b3001 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:46.817085 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7b0c5176-ebf6-4f67-8671-a2d2f93b3001 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:46.817536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7b0c5176-ebf6-4f67-8671-a2d2f93b3001 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:46.830250 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-30c56225-7402-4ac7-b13b-539821ea38c7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:46.838007 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-30c56225-7402-4ac7-b13b-539821ea38c7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1365 microversion: 2.1 time: 0.446285 Sep 15 13:02:46.838571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 171/349] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:46 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1365 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:46.879269 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7b0c5176-ebf6-4f67-8671-a2d2f93b3001 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Going to try to stop instance {{(pid=120633) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 15 13:02:46.922287 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7b0c5176-ebf6-4f67-8671-a2d2f93b3001 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "POST /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/action" status: 202 len: 0 microversion: 2.1 time: 0.116303 Sep 15 13:02:46.923009 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 179/350] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Sep 15 13:02:46 2022] POST /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:02:46.931223 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1e27cd9d-2dd1-444b-a865-c019edca8177 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:46.931766 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1e27cd9d-2dd1-444b-a865-c019edca8177 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:46.939596 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e27cd9d-2dd1-444b-a865-c019edca8177 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:46.940181 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e27cd9d-2dd1-444b-a865-c019edca8177 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:46.940858 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e27cd9d-2dd1-444b-a865-c019edca8177 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:46.941677 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e27cd9d-2dd1-444b-a865-c019edca8177 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:46.942246 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e27cd9d-2dd1-444b-a865-c019edca8177 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:46.942673 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1e27cd9d-2dd1-444b-a865-c019edca8177 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:46.968896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-6eec4c42-03e0-434a-bb09-ddfec8c4e3fc req-bdf01efd-dd83-417d-939e-ed421bb470fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2628b91-c3d5-4bc0-88ed-c6786c051876", "tag": "80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:02:46.978723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-6eec4c42-03e0-434a-bb09-ddfec8c4e3fc req-bdf01efd-dd83-417d-939e-ed421bb470fb service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:46.979192 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-6eec4c42-03e0-434a-bb09-ddfec8c4e3fc req-bdf01efd-dd83-417d-939e-ed421bb470fb service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:46.979615 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-6eec4c42-03e0-434a-bb09-ddfec8c4e3fc req-bdf01efd-dd83-417d-939e-ed421bb470fb service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:46.990928 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-6eec4c42-03e0-434a-bb09-ddfec8c4e3fc req-bdf01efd-dd83-417d-939e-ed421bb470fb service nova] Creating event network-changed:80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80 for instance e2628b91-c3d5-4bc0-88ed-c6786c051876 on hv-cinder-83608 Sep 15 13:02:46.996077 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-6eec4c42-03e0-434a-bb09-ddfec8c4e3fc req-bdf01efd-dd83-417d-939e-ed421bb470fb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031928 Sep 15 13:02:46.996676 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 180/351] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:02:47.177292 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1e27cd9d-2dd1-444b-a865-c019edca8177 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:47.195265 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1e27cd9d-2dd1-444b-a865-c019edca8177 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1720 microversion: 2.1 time: 0.267812 Sep 15 13:02:47.195836 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 172/352] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:46 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1720 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:47.549594 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-18c7a882-9add-4e33-958b-017373be5845 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:47.550216 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-18c7a882-9add-4e33-958b-017373be5845 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:47.556854 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-18c7a882-9add-4e33-958b-017373be5845 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:47.557335 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-18c7a882-9add-4e33-958b-017373be5845 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:47.557767 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-18c7a882-9add-4e33-958b-017373be5845 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:47.558455 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-18c7a882-9add-4e33-958b-017373be5845 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:47.558909 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-18c7a882-9add-4e33-958b-017373be5845 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:47.559333 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-18c7a882-9add-4e33-958b-017373be5845 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:47.697365 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-18c7a882-9add-4e33-958b-017373be5845 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:47.700896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:47.706090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-18c7a882-9add-4e33-958b-017373be5845 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.161410 Sep 15 13:02:47.706646 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 181/353] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:47 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:47.779801 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-eacf0c0d-ea7d-48d3-acee-64e2f421c233 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:47.781105 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-eacf0c0d-ea7d-48d3-acee-64e2f421c233 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:47.787019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-eacf0c0d-ea7d-48d3-acee-64e2f421c233 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:47.787504 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-eacf0c0d-ea7d-48d3-acee-64e2f421c233 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:47.787935 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-eacf0c0d-ea7d-48d3-acee-64e2f421c233 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:47.788642 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-eacf0c0d-ea7d-48d3-acee-64e2f421c233 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:47.789093 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-eacf0c0d-ea7d-48d3-acee-64e2f421c233 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:47.789511 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-eacf0c0d-ea7d-48d3-acee-64e2f421c233 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:47.860981 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5a0d4032-4370-40cc-86e6-92753e4839d4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:47.861612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-5a0d4032-4370-40cc-86e6-92753e4839d4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:47.868911 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5a0d4032-4370-40cc-86e6-92753e4839d4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:47.869470 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5a0d4032-4370-40cc-86e6-92753e4839d4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:47.869978 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5a0d4032-4370-40cc-86e6-92753e4839d4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:47.870682 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5a0d4032-4370-40cc-86e6-92753e4839d4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:47.871132 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5a0d4032-4370-40cc-86e6-92753e4839d4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:47.871556 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5a0d4032-4370-40cc-86e6-92753e4839d4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:47.921480 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-eacf0c0d-ea7d-48d3-acee-64e2f421c233 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:47.929505 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-eacf0c0d-ea7d-48d3-acee-64e2f421c233 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:47.930950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-eacf0c0d-ea7d-48d3-acee-64e2f421c233 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:47.932109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-eacf0c0d-ea7d-48d3-acee-64e2f421c233 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1724 microversion: 2.20 time: 0.156265 Sep 15 13:02:47.932695 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 173/354] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:47 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:48.000216 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-5a0d4032-4370-40cc-86e6-92753e4839d4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:48.007969 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-5a0d4032-4370-40cc-86e6-92753e4839d4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1365 microversion: 2.1 time: 0.150975 Sep 15 13:02:48.008570 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 182/355] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:47 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:48.218879 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e82fa6ce-e73e-4c82-ad16-c7c18b3eb310 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:48.219517 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-e82fa6ce-e73e-4c82-ad16-c7c18b3eb310 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:48.225398 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e82fa6ce-e73e-4c82-ad16-c7c18b3eb310 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:48.225873 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e82fa6ce-e73e-4c82-ad16-c7c18b3eb310 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:48.226298 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e82fa6ce-e73e-4c82-ad16-c7c18b3eb310 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:48.226970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e82fa6ce-e73e-4c82-ad16-c7c18b3eb310 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:48.227436 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e82fa6ce-e73e-4c82-ad16-c7c18b3eb310 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:48.227833 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e82fa6ce-e73e-4c82-ad16-c7c18b3eb310 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:48.357091 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e82fa6ce-e73e-4c82-ad16-c7c18b3eb310 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:48.365531 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e82fa6ce-e73e-4c82-ad16-c7c18b3eb310 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1720 microversion: 2.1 time: 0.150562 Sep 15 13:02:48.366097 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 174/356] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:48 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:48.729298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e2a7de67-b402-429c-9873-f28869d09183 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:48.729905 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e2a7de67-b402-429c-9873-f28869d09183 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:48.737006 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e2a7de67-b402-429c-9873-f28869d09183 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:48.737483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e2a7de67-b402-429c-9873-f28869d09183 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:48.737936 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e2a7de67-b402-429c-9873-f28869d09183 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:48.738615 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e2a7de67-b402-429c-9873-f28869d09183 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:48.739057 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e2a7de67-b402-429c-9873-f28869d09183 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:48.739471 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e2a7de67-b402-429c-9873-f28869d09183 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:48.869988 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e2a7de67-b402-429c-9873-f28869d09183 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:48.878370 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e2a7de67-b402-429c-9873-f28869d09183 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.152906 Sep 15 13:02:48.878932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 183/357] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:48 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:02:48.957250 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8b04d840-b428-4dd7-bcea-14c26c3365d4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:48.957854 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8b04d840-b428-4dd7-bcea-14c26c3365d4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:48.963780 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8b04d840-b428-4dd7-bcea-14c26c3365d4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:48.964252 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8b04d840-b428-4dd7-bcea-14c26c3365d4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:48.964704 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8b04d840-b428-4dd7-bcea-14c26c3365d4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:48.965378 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8b04d840-b428-4dd7-bcea-14c26c3365d4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:48.965823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8b04d840-b428-4dd7-bcea-14c26c3365d4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:48.966239 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8b04d840-b428-4dd7-bcea-14c26c3365d4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:49.031559 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f37be90f-ebac-4abd-ad2b-d4d0c0aea200 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:49.032084 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f37be90f-ebac-4abd-ad2b-d4d0c0aea200 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:49.037930 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f37be90f-ebac-4abd-ad2b-d4d0c0aea200 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:49.038409 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f37be90f-ebac-4abd-ad2b-d4d0c0aea200 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:49.038835 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f37be90f-ebac-4abd-ad2b-d4d0c0aea200 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:49.039521 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f37be90f-ebac-4abd-ad2b-d4d0c0aea200 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:49.039965 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f37be90f-ebac-4abd-ad2b-d4d0c0aea200 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:49.040410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f37be90f-ebac-4abd-ad2b-d4d0c0aea200 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:49.094638 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8b04d840-b428-4dd7-bcea-14c26c3365d4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:49.103444 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8b04d840-b428-4dd7-bcea-14c26c3365d4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:49.105107 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8b04d840-b428-4dd7-bcea-14c26c3365d4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:49.106397 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8b04d840-b428-4dd7-bcea-14c26c3365d4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1724 microversion: 2.20 time: 0.153293 Sep 15 13:02:49.107174 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 175/358] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:48 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:49.169791 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f37be90f-ebac-4abd-ad2b-d4d0c0aea200 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:49.177894 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f37be90f-ebac-4abd-ad2b-d4d0c0aea200 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1365 microversion: 2.1 time: 0.150794 Sep 15 13:02:49.178453 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 184/359] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:49 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:02:49.389305 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4f50303e-4d02-4e5b-a32e-f83b8be86490 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:49.390435 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-4f50303e-4d02-4e5b-a32e-f83b8be86490 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:49.396699 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4f50303e-4d02-4e5b-a32e-f83b8be86490 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:49.397181 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4f50303e-4d02-4e5b-a32e-f83b8be86490 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:49.397615 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4f50303e-4d02-4e5b-a32e-f83b8be86490 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:49.398304 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4f50303e-4d02-4e5b-a32e-f83b8be86490 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:49.398758 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4f50303e-4d02-4e5b-a32e-f83b8be86490 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:49.399180 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4f50303e-4d02-4e5b-a32e-f83b8be86490 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:49.526895 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-4f50303e-4d02-4e5b-a32e-f83b8be86490 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:49.535860 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-4f50303e-4d02-4e5b-a32e-f83b8be86490 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1720 microversion: 2.1 time: 0.150383 Sep 15 13:02:49.536444 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 176/360] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:49 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:49.900341 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-12fa0cb5-1942-4109-9fb0-027093382f9d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:49.900970 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-12fa0cb5-1942-4109-9fb0-027093382f9d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:49.909047 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-12fa0cb5-1942-4109-9fb0-027093382f9d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:49.909540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-12fa0cb5-1942-4109-9fb0-027093382f9d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:49.909980 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-12fa0cb5-1942-4109-9fb0-027093382f9d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:49.910685 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-12fa0cb5-1942-4109-9fb0-027093382f9d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:49.911141 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-12fa0cb5-1942-4109-9fb0-027093382f9d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:49.911567 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-12fa0cb5-1942-4109-9fb0-027093382f9d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:50.042946 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-12fa0cb5-1942-4109-9fb0-027093382f9d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:50.050851 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-12fa0cb5-1942-4109-9fb0-027093382f9d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.154335 Sep 15 13:02:50.051420 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 185/361] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:49 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:50.132768 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e298a423-0480-46ca-b891-4f2c540f7e7c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:50.133376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-e298a423-0480-46ca-b891-4f2c540f7e7c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:50.139244 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e298a423-0480-46ca-b891-4f2c540f7e7c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:50.140408 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e298a423-0480-46ca-b891-4f2c540f7e7c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:50.140836 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e298a423-0480-46ca-b891-4f2c540f7e7c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:50.141518 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e298a423-0480-46ca-b891-4f2c540f7e7c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:50.141963 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e298a423-0480-46ca-b891-4f2c540f7e7c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:50.142378 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e298a423-0480-46ca-b891-4f2c540f7e7c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:50.146694 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:50.201251 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a0acd8a8-098f-4949-b6ef-da4cde073c09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:50.201891 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a0acd8a8-098f-4949-b6ef-da4cde073c09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:50.208004 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a0acd8a8-098f-4949-b6ef-da4cde073c09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:50.208520 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a0acd8a8-098f-4949-b6ef-da4cde073c09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:50.208948 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a0acd8a8-098f-4949-b6ef-da4cde073c09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:50.209630 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a0acd8a8-098f-4949-b6ef-da4cde073c09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:50.210073 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a0acd8a8-098f-4949-b6ef-da4cde073c09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:50.210483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a0acd8a8-098f-4949-b6ef-da4cde073c09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:50.273378 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e298a423-0480-46ca-b891-4f2c540f7e7c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:50.281450 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e298a423-0480-46ca-b891-4f2c540f7e7c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:50.282890 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e298a423-0480-46ca-b891-4f2c540f7e7c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:50.284045 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e298a423-0480-46ca-b891-4f2c540f7e7c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1724 microversion: 2.20 time: 0.155409 Sep 15 13:02:50.284647 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 177/362] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:50 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:50.545001 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a0acd8a8-098f-4949-b6ef-da4cde073c09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:50.553104 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a0acd8a8-098f-4949-b6ef-da4cde073c09 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1365 microversion: 2.1 time: 0.355844 Sep 15 13:02:50.553668 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 186/363] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:50 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:02:50.559038 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-bac21195-d80d-4bbd-9ea0-09bbd74ee034 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:50.559736 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-bac21195-d80d-4bbd-9ea0-09bbd74ee034 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:50.565789 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bac21195-d80d-4bbd-9ea0-09bbd74ee034 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:50.566349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bac21195-d80d-4bbd-9ea0-09bbd74ee034 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:50.566843 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bac21195-d80d-4bbd-9ea0-09bbd74ee034 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:50.567587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bac21195-d80d-4bbd-9ea0-09bbd74ee034 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:50.568103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bac21195-d80d-4bbd-9ea0-09bbd74ee034 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:50.568559 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bac21195-d80d-4bbd-9ea0-09bbd74ee034 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:50.696613 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-bac21195-d80d-4bbd-9ea0-09bbd74ee034 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:50.704898 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-bac21195-d80d-4bbd-9ea0-09bbd74ee034 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1720 microversion: 2.1 time: 0.149666 Sep 15 13:02:50.705456 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 178/364] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:50 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:51.073210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4cc88b30-eec9-4718-8604-42afa6dfec32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:51.073815 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-4cc88b30-eec9-4718-8604-42afa6dfec32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:51.080520 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4cc88b30-eec9-4718-8604-42afa6dfec32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:51.081002 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4cc88b30-eec9-4718-8604-42afa6dfec32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:51.081434 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4cc88b30-eec9-4718-8604-42afa6dfec32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:51.082119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4cc88b30-eec9-4718-8604-42afa6dfec32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:51.082565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4cc88b30-eec9-4718-8604-42afa6dfec32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:51.082980 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4cc88b30-eec9-4718-8604-42afa6dfec32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:51.215035 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4cc88b30-eec9-4718-8604-42afa6dfec32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:51.223287 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-4cc88b30-eec9-4718-8604-42afa6dfec32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.153871 Sep 15 13:02:51.223854 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 187/365] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:51 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:51.309705 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f9f6aa2f-e49a-4bf7-9ee8-86dde86dd73b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:51.310340 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f9f6aa2f-e49a-4bf7-9ee8-86dde86dd73b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:51.312195 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:51.318019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f9f6aa2f-e49a-4bf7-9ee8-86dde86dd73b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:51.318501 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f9f6aa2f-e49a-4bf7-9ee8-86dde86dd73b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:51.318933 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f9f6aa2f-e49a-4bf7-9ee8-86dde86dd73b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:51.319617 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f9f6aa2f-e49a-4bf7-9ee8-86dde86dd73b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:51.320069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f9f6aa2f-e49a-4bf7-9ee8-86dde86dd73b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:51.320521 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f9f6aa2f-e49a-4bf7-9ee8-86dde86dd73b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:51.547466 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f9f6aa2f-e49a-4bf7-9ee8-86dde86dd73b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:51.555676 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f9f6aa2f-e49a-4bf7-9ee8-86dde86dd73b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:51.557147 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f9f6aa2f-e49a-4bf7-9ee8-86dde86dd73b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:51.558312 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f9f6aa2f-e49a-4bf7-9ee8-86dde86dd73b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1724 microversion: 2.20 time: 0.252498 Sep 15 13:02:51.569771 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 179/366] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:51 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:51.579465 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-423a14c7-c657-41d4-9d6a-93cdee666723 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:51.581204 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-423a14c7-c657-41d4-9d6a-93cdee666723 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:51.583840 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:51.589270 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-423a14c7-c657-41d4-9d6a-93cdee666723 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:51.589940 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-423a14c7-c657-41d4-9d6a-93cdee666723 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:51.590375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-423a14c7-c657-41d4-9d6a-93cdee666723 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:51.591071 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-423a14c7-c657-41d4-9d6a-93cdee666723 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:51.591805 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-423a14c7-c657-41d4-9d6a-93cdee666723 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:51.591954 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-423a14c7-c657-41d4-9d6a-93cdee666723 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:51.731277 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0008c903-c625-45ff-b821-db142bafcd2e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:51.732653 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0008c903-c625-45ff-b821-db142bafcd2e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:51.739129 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-423a14c7-c657-41d4-9d6a-93cdee666723 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:51.747325 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0008c903-c625-45ff-b821-db142bafcd2e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:51.747942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=12 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:51.750200 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0008c903-c625-45ff-b821-db142bafcd2e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:51.750738 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0008c903-c625-45ff-b821-db142bafcd2e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:51.751661 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0008c903-c625-45ff-b821-db142bafcd2e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:51.752115 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0008c903-c625-45ff-b821-db142bafcd2e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:51.752565 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0008c903-c625-45ff-b821-db142bafcd2e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:51.763456 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-423a14c7-c657-41d4-9d6a-93cdee666723 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1365 microversion: 2.1 time: 0.189793 Sep 15 13:02:51.764067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 188/367] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:51 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:51.776729 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=8 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:51.940225 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0008c903-c625-45ff-b821-db142bafcd2e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:51.948579 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0008c903-c625-45ff-b821-db142bafcd2e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1720 microversion: 2.1 time: 0.221804 Sep 15 13:02:51.949147 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 180/368] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:51 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1720 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:52.246566 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c5de4e7c-7eb3-4e96-8f3c-e0fae17923d8 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:52.247170 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c5de4e7c-7eb3-4e96-8f3c-e0fae17923d8 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:52.254619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c5de4e7c-7eb3-4e96-8f3c-e0fae17923d8 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:52.255098 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c5de4e7c-7eb3-4e96-8f3c-e0fae17923d8 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:52.255525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c5de4e7c-7eb3-4e96-8f3c-e0fae17923d8 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:52.256207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c5de4e7c-7eb3-4e96-8f3c-e0fae17923d8 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:52.256684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c5de4e7c-7eb3-4e96-8f3c-e0fae17923d8 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:52.257099 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c5de4e7c-7eb3-4e96-8f3c-e0fae17923d8 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:52.383026 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c5de4e7c-7eb3-4e96-8f3c-e0fae17923d8 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:52.391399 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c5de4e7c-7eb3-4e96-8f3c-e0fae17923d8 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.148724 Sep 15 13:02:52.391963 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 189/369] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:52 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:52.588800 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-9285e9ad-3518-4404-99d2-3d3110706731 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:52.589441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-9285e9ad-3518-4404-99d2-3d3110706731 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:52.595514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9285e9ad-3518-4404-99d2-3d3110706731 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:52.595998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9285e9ad-3518-4404-99d2-3d3110706731 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:52.596469 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9285e9ad-3518-4404-99d2-3d3110706731 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:52.597160 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9285e9ad-3518-4404-99d2-3d3110706731 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:52.597614 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9285e9ad-3518-4404-99d2-3d3110706731 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:52.598038 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9285e9ad-3518-4404-99d2-3d3110706731 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:52.725410 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9285e9ad-3518-4404-99d2-3d3110706731 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:52.734130 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9285e9ad-3518-4404-99d2-3d3110706731 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:52.735570 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9285e9ad-3518-4404-99d2-3d3110706731 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:52.736774 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-9285e9ad-3518-4404-99d2-3d3110706731 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1724 microversion: 2.20 time: 0.151862 Sep 15 13:02:52.737332 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 181/370] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:52 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:52.790956 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-338b744a-fea1-4854-8e7a-aa5d56e7f6af tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:52.791570 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-338b744a-fea1-4854-8e7a-aa5d56e7f6af tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:52.798191 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-338b744a-fea1-4854-8e7a-aa5d56e7f6af tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:52.798668 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-338b744a-fea1-4854-8e7a-aa5d56e7f6af tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:52.799098 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-338b744a-fea1-4854-8e7a-aa5d56e7f6af tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:52.799839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-338b744a-fea1-4854-8e7a-aa5d56e7f6af tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:52.800240 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-338b744a-fea1-4854-8e7a-aa5d56e7f6af tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:52.800699 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-338b744a-fea1-4854-8e7a-aa5d56e7f6af tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:52.927650 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-338b744a-fea1-4854-8e7a-aa5d56e7f6af tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:52.936155 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-338b744a-fea1-4854-8e7a-aa5d56e7f6af tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1365 microversion: 2.1 time: 0.149084 Sep 15 13:02:52.936767 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 190/371] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:52 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:52.972970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f8f7f926-0e21-4c71-afc0-337c62d02340 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:52.973581 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f8f7f926-0e21-4c71-afc0-337c62d02340 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:52.979468 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f8f7f926-0e21-4c71-afc0-337c62d02340 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:52.979946 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f8f7f926-0e21-4c71-afc0-337c62d02340 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:52.980406 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f8f7f926-0e21-4c71-afc0-337c62d02340 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:52.981097 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f8f7f926-0e21-4c71-afc0-337c62d02340 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:52.981546 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f8f7f926-0e21-4c71-afc0-337c62d02340 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:52.981963 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f8f7f926-0e21-4c71-afc0-337c62d02340 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:53.110354 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f8f7f926-0e21-4c71-afc0-337c62d02340 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:53.118509 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f8f7f926-0e21-4c71-afc0-337c62d02340 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1720 microversion: 2.1 time: 0.149384 Sep 15 13:02:53.119090 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 182/372] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:52 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:53.414114 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e3f51914-dc57-4ee3-a6a0-375d9954f99e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:53.414774 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e3f51914-dc57-4ee3-a6a0-375d9954f99e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:53.421727 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e3f51914-dc57-4ee3-a6a0-375d9954f99e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:53.422213 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e3f51914-dc57-4ee3-a6a0-375d9954f99e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:53.422644 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e3f51914-dc57-4ee3-a6a0-375d9954f99e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:53.423333 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e3f51914-dc57-4ee3-a6a0-375d9954f99e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:53.423786 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e3f51914-dc57-4ee3-a6a0-375d9954f99e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:53.424208 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e3f51914-dc57-4ee3-a6a0-375d9954f99e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:53.554949 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e3f51914-dc57-4ee3-a6a0-375d9954f99e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:53.562650 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e3f51914-dc57-4ee3-a6a0-375d9954f99e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.152344 Sep 15 13:02:53.563202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 191/373] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:53 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:53.762040 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-53cf3827-8bf8-4bbf-8e3f-a496f1512653 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:53.762651 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-53cf3827-8bf8-4bbf-8e3f-a496f1512653 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:53.770001 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-53cf3827-8bf8-4bbf-8e3f-a496f1512653 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:53.770609 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-53cf3827-8bf8-4bbf-8e3f-a496f1512653 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:53.771044 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-53cf3827-8bf8-4bbf-8e3f-a496f1512653 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:53.771734 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-53cf3827-8bf8-4bbf-8e3f-a496f1512653 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:53.772188 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-53cf3827-8bf8-4bbf-8e3f-a496f1512653 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:53.772648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-53cf3827-8bf8-4bbf-8e3f-a496f1512653 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:53.904157 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-53cf3827-8bf8-4bbf-8e3f-a496f1512653 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:53.912844 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-53cf3827-8bf8-4bbf-8e3f-a496f1512653 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:53.914296 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-53cf3827-8bf8-4bbf-8e3f-a496f1512653 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:53.915454 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-53cf3827-8bf8-4bbf-8e3f-a496f1512653 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1745 microversion: 2.20 time: 0.157364 Sep 15 13:02:53.916011 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 183/374] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:53 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:53.958860 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e5e1b88f-b477-4269-9e80-849031c26266 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:53.959477 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e5e1b88f-b477-4269-9e80-849031c26266 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:53.965375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e5e1b88f-b477-4269-9e80-849031c26266 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:53.965856 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e5e1b88f-b477-4269-9e80-849031c26266 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:53.966289 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e5e1b88f-b477-4269-9e80-849031c26266 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:53.966973 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e5e1b88f-b477-4269-9e80-849031c26266 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:53.967427 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e5e1b88f-b477-4269-9e80-849031c26266 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:53.968463 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e5e1b88f-b477-4269-9e80-849031c26266 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:54.092254 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e5e1b88f-b477-4269-9e80-849031c26266 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:54.100599 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e5e1b88f-b477-4269-9e80-849031c26266 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1365 microversion: 2.1 time: 0.145450 Sep 15 13:02:54.101198 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 192/375] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:53 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:54.141720 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1fbc2bcb-b1dc-4674-ae2b-1095ceff2a12 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:54.142362 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1fbc2bcb-b1dc-4674-ae2b-1095ceff2a12 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:54.148567 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1fbc2bcb-b1dc-4674-ae2b-1095ceff2a12 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:54.149055 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1fbc2bcb-b1dc-4674-ae2b-1095ceff2a12 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:54.149491 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1fbc2bcb-b1dc-4674-ae2b-1095ceff2a12 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:54.150185 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1fbc2bcb-b1dc-4674-ae2b-1095ceff2a12 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:54.150638 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1fbc2bcb-b1dc-4674-ae2b-1095ceff2a12 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:54.151061 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1fbc2bcb-b1dc-4674-ae2b-1095ceff2a12 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:54.278290 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1fbc2bcb-b1dc-4674-ae2b-1095ceff2a12 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:54.287058 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1fbc2bcb-b1dc-4674-ae2b-1095ceff2a12 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1720 microversion: 2.1 time: 0.149844 Sep 15 13:02:54.287843 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 184/376] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:54 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:54.383124 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-6bc4cf0e-f121-48ed-a91a-aa60c25a18e5 req-43209b5f-d268-4d08-9783-5b512ee40d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5170c49a-0d2d-487f-abc1-2cc80ebb31b4", "name": "network-vif-plugged", "status": "completed", "tag": "a40c3efd-d157-4cf4-9c28-2e3f09f142e7"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:02:54.393651 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-6bc4cf0e-f121-48ed-a91a-aa60c25a18e5 req-43209b5f-d268-4d08-9783-5b512ee40d49 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:54.394205 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-6bc4cf0e-f121-48ed-a91a-aa60c25a18e5 req-43209b5f-d268-4d08-9783-5b512ee40d49 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:54.394692 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-6bc4cf0e-f121-48ed-a91a-aa60c25a18e5 req-43209b5f-d268-4d08-9783-5b512ee40d49 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:54.407352 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-6bc4cf0e-f121-48ed-a91a-aa60c25a18e5 req-43209b5f-d268-4d08-9783-5b512ee40d49 service nova] Creating event network-vif-plugged:a40c3efd-d157-4cf4-9c28-2e3f09f142e7 for instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 on hv-cinder-83608 Sep 15 13:02:54.412240 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-6bc4cf0e-f121-48ed-a91a-aa60c25a18e5 req-43209b5f-d268-4d08-9783-5b512ee40d49 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032769 Sep 15 13:02:54.412865 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 193/377] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:02:54.585246 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ae0f0110-fad1-4072-abc8-3f56348b21fc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:54.585861 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ae0f0110-fad1-4072-abc8-3f56348b21fc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:54.591928 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ae0f0110-fad1-4072-abc8-3f56348b21fc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:54.592464 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ae0f0110-fad1-4072-abc8-3f56348b21fc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:54.593746 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ae0f0110-fad1-4072-abc8-3f56348b21fc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:54.594443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ae0f0110-fad1-4072-abc8-3f56348b21fc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:54.594944 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ae0f0110-fad1-4072-abc8-3f56348b21fc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:54.595355 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ae0f0110-fad1-4072-abc8-3f56348b21fc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:54.788211 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ae0f0110-fad1-4072-abc8-3f56348b21fc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:54.796055 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ae0f0110-fad1-4072-abc8-3f56348b21fc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.214672 Sep 15 13:02:54.796694 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 185/378] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:54 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:54.942121 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d30bb08f-a101-44e2-867d-4d193c13c8ec tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:54.942806 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d30bb08f-a101-44e2-867d-4d193c13c8ec tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:54.948895 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d30bb08f-a101-44e2-867d-4d193c13c8ec tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:54.949369 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d30bb08f-a101-44e2-867d-4d193c13c8ec tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:54.949795 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d30bb08f-a101-44e2-867d-4d193c13c8ec tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:54.950472 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d30bb08f-a101-44e2-867d-4d193c13c8ec tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:54.950963 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d30bb08f-a101-44e2-867d-4d193c13c8ec tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:54.951329 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d30bb08f-a101-44e2-867d-4d193c13c8ec tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:55.081947 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d30bb08f-a101-44e2-867d-4d193c13c8ec tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:55.090187 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d30bb08f-a101-44e2-867d-4d193c13c8ec tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:55.091637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d30bb08f-a101-44e2-867d-4d193c13c8ec tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:55.092860 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d30bb08f-a101-44e2-867d-4d193c13c8ec tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1745 microversion: 2.20 time: 0.156200 Sep 15 13:02:55.093411 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 194/379] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:54 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:55.122778 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2bc70adc-511d-4575-91fa-3c342963ecd2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:55.123398 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2bc70adc-511d-4575-91fa-3c342963ecd2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:55.129963 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bc70adc-511d-4575-91fa-3c342963ecd2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:55.130451 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bc70adc-511d-4575-91fa-3c342963ecd2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:55.130887 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bc70adc-511d-4575-91fa-3c342963ecd2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:55.131579 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bc70adc-511d-4575-91fa-3c342963ecd2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:55.132031 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bc70adc-511d-4575-91fa-3c342963ecd2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:55.132487 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bc70adc-511d-4575-91fa-3c342963ecd2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:55.261838 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2bc70adc-511d-4575-91fa-3c342963ecd2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:55.269823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2bc70adc-511d-4575-91fa-3c342963ecd2 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1365 microversion: 2.1 time: 0.150887 Sep 15 13:02:55.270388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 186/380] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:55 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:55.309869 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b1007a64-ad07-477a-ba32-fe33bb14508c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:55.310473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b1007a64-ad07-477a-ba32-fe33bb14508c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:55.317461 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b1007a64-ad07-477a-ba32-fe33bb14508c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:55.317936 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b1007a64-ad07-477a-ba32-fe33bb14508c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:55.318363 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b1007a64-ad07-477a-ba32-fe33bb14508c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:55.319044 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b1007a64-ad07-477a-ba32-fe33bb14508c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:55.319488 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b1007a64-ad07-477a-ba32-fe33bb14508c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:55.319902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b1007a64-ad07-477a-ba32-fe33bb14508c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:55.448012 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b1007a64-ad07-477a-ba32-fe33bb14508c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:55.456337 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b1007a64-ad07-477a-ba32-fe33bb14508c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1720 microversion: 2.1 time: 0.150230 Sep 15 13:02:55.456902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 195/381] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:55 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:55.818245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fa8a40ac-d58c-425a-bf5f-3a09564da3f0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:55.818853 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-fa8a40ac-d58c-425a-bf5f-3a09564da3f0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:55.824976 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fa8a40ac-d58c-425a-bf5f-3a09564da3f0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:55.825456 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fa8a40ac-d58c-425a-bf5f-3a09564da3f0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:55.825888 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fa8a40ac-d58c-425a-bf5f-3a09564da3f0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:55.826570 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fa8a40ac-d58c-425a-bf5f-3a09564da3f0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:55.827117 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fa8a40ac-d58c-425a-bf5f-3a09564da3f0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:55.827597 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fa8a40ac-d58c-425a-bf5f-3a09564da3f0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:55.960178 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-fa8a40ac-d58c-425a-bf5f-3a09564da3f0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:55.968457 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-fa8a40ac-d58c-425a-bf5f-3a09564da3f0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.153493 Sep 15 13:02:55.969066 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 187/382] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:55 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:56.118011 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a48c236c-b325-4f81-b0ab-e27bd96c628c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:56.118627 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a48c236c-b325-4f81-b0ab-e27bd96c628c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:56.126027 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a48c236c-b325-4f81-b0ab-e27bd96c628c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:56.126507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a48c236c-b325-4f81-b0ab-e27bd96c628c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:56.126940 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a48c236c-b325-4f81-b0ab-e27bd96c628c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:56.127663 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a48c236c-b325-4f81-b0ab-e27bd96c628c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:56.128118 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a48c236c-b325-4f81-b0ab-e27bd96c628c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:56.128563 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a48c236c-b325-4f81-b0ab-e27bd96c628c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:56.260630 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a48c236c-b325-4f81-b0ab-e27bd96c628c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:56.270227 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a48c236c-b325-4f81-b0ab-e27bd96c628c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:56.271670 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a48c236c-b325-4f81-b0ab-e27bd96c628c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:56.272915 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a48c236c-b325-4f81-b0ab-e27bd96c628c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1745 microversion: 2.20 time: 0.158811 Sep 15 13:02:56.273460 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 196/383] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:56 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:56.292691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-43956809-efbd-47f2-9fca-e5d0c16df203 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:56.293307 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-43956809-efbd-47f2-9fca-e5d0c16df203 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:56.299593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-43956809-efbd-47f2-9fca-e5d0c16df203 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:56.300078 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-43956809-efbd-47f2-9fca-e5d0c16df203 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:56.300538 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-43956809-efbd-47f2-9fca-e5d0c16df203 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:56.301237 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-43956809-efbd-47f2-9fca-e5d0c16df203 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:56.301690 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-43956809-efbd-47f2-9fca-e5d0c16df203 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:56.302111 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-43956809-efbd-47f2-9fca-e5d0c16df203 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:56.432422 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-43956809-efbd-47f2-9fca-e5d0c16df203 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:56.440928 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-43956809-efbd-47f2-9fca-e5d0c16df203 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1365 microversion: 2.1 time: 0.152107 Sep 15 13:02:56.441609 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 188/384] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:56 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:56.480244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7a1fdaef-4c7c-4756-958d-2aeb4ddee035 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:56.480904 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7a1fdaef-4c7c-4756-958d-2aeb4ddee035 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:56.487750 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7a1fdaef-4c7c-4756-958d-2aeb4ddee035 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:56.488238 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7a1fdaef-4c7c-4756-958d-2aeb4ddee035 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:56.488709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7a1fdaef-4c7c-4756-958d-2aeb4ddee035 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:56.489410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7a1fdaef-4c7c-4756-958d-2aeb4ddee035 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:56.489868 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7a1fdaef-4c7c-4756-958d-2aeb4ddee035 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:56.490296 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7a1fdaef-4c7c-4756-958d-2aeb4ddee035 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:56.615752 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7a1fdaef-4c7c-4756-958d-2aeb4ddee035 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:56.624528 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7a1fdaef-4c7c-4756-958d-2aeb4ddee035 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1720 microversion: 2.1 time: 0.148365 Sep 15 13:02:56.625276 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 197/385] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:56 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:56.990883 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-63422b49-6091-4793-ada4-3d4d67731bd7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:56.991499 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-63422b49-6091-4793-ada4-3d4d67731bd7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:56.997519 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-63422b49-6091-4793-ada4-3d4d67731bd7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:56.998006 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-63422b49-6091-4793-ada4-3d4d67731bd7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:56.998443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-63422b49-6091-4793-ada4-3d4d67731bd7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:56.999272 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-63422b49-6091-4793-ada4-3d4d67731bd7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:56.999728 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-63422b49-6091-4793-ada4-3d4d67731bd7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:57.000155 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-63422b49-6091-4793-ada4-3d4d67731bd7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:57.134009 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-63422b49-6091-4793-ada4-3d4d67731bd7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:57.142124 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-63422b49-6091-4793-ada4-3d4d67731bd7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.155185 Sep 15 13:02:57.142726 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 189/386] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:56 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:57.301113 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9f6f6523-2df6-4de3-a58e-88967e2683c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:57.301623 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9f6f6523-2df6-4de3-a58e-88967e2683c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:57.307963 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9f6f6523-2df6-4de3-a58e-88967e2683c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:57.308477 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9f6f6523-2df6-4de3-a58e-88967e2683c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:57.308909 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9f6f6523-2df6-4de3-a58e-88967e2683c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:57.309588 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9f6f6523-2df6-4de3-a58e-88967e2683c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:57.310034 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9f6f6523-2df6-4de3-a58e-88967e2683c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:57.310449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9f6f6523-2df6-4de3-a58e-88967e2683c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:57.442906 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9f6f6523-2df6-4de3-a58e-88967e2683c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:57.450973 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9f6f6523-2df6-4de3-a58e-88967e2683c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:57.452528 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9f6f6523-2df6-4de3-a58e-88967e2683c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:57.453678 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9f6f6523-2df6-4de3-a58e-88967e2683c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1745 microversion: 2.20 time: 0.158051 Sep 15 13:02:57.454235 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 198/387] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:57 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:57.463092 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6e066ffa-2d5a-43dd-8dae-0e930f5e15e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:57.463777 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6e066ffa-2d5a-43dd-8dae-0e930f5e15e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:57.470244 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6e066ffa-2d5a-43dd-8dae-0e930f5e15e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:57.470811 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6e066ffa-2d5a-43dd-8dae-0e930f5e15e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:57.471305 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6e066ffa-2d5a-43dd-8dae-0e930f5e15e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:57.472050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6e066ffa-2d5a-43dd-8dae-0e930f5e15e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:57.472528 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6e066ffa-2d5a-43dd-8dae-0e930f5e15e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:57.472943 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6e066ffa-2d5a-43dd-8dae-0e930f5e15e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:57.602953 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6e066ffa-2d5a-43dd-8dae-0e930f5e15e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:57.611346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6e066ffa-2d5a-43dd-8dae-0e930f5e15e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1556 microversion: 2.1 time: 0.152057 Sep 15 13:02:57.611911 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 190/388] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:57 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:57.634078 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d9c65249-9300-40a5-a4a4-af82eda94a1c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:57.634578 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d9c65249-9300-40a5-a4a4-af82eda94a1c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:57.640564 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d9c65249-9300-40a5-a4a4-af82eda94a1c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:57.641031 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d9c65249-9300-40a5-a4a4-af82eda94a1c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:57.641467 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d9c65249-9300-40a5-a4a4-af82eda94a1c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:57.642190 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d9c65249-9300-40a5-a4a4-af82eda94a1c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:57.642672 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d9c65249-9300-40a5-a4a4-af82eda94a1c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:57.643096 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d9c65249-9300-40a5-a4a4-af82eda94a1c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:57.647218 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=100 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:57.648448 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-31e63059-df23-40a5-bd1b-b69d52b96267 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:57.649063 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-31e63059-df23-40a5-bd1b-b69d52b96267 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:57.650921 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:57.656085 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-31e63059-df23-40a5-bd1b-b69d52b96267 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:57.656606 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-31e63059-df23-40a5-bd1b-b69d52b96267 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:57.657046 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-31e63059-df23-40a5-bd1b-b69d52b96267 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:57.657745 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-31e63059-df23-40a5-bd1b-b69d52b96267 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:57.658201 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-31e63059-df23-40a5-bd1b-b69d52b96267 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:57.658625 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-31e63059-df23-40a5-bd1b-b69d52b96267 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:57.726019 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d9c65249-9300-40a5-a4a4-af82eda94a1c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095821 Sep 15 13:02:57.726699 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 199/389] 10.222.0.57 () {58 vars in 1275 bytes} [Thu Sep 15 13:02:57 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:02:57.797791 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-31e63059-df23-40a5-bd1b-b69d52b96267 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:57.806486 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-31e63059-df23-40a5-bd1b-b69d52b96267 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1720 microversion: 2.1 time: 0.161672 Sep 15 13:02:57.807101 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 191/390] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:57 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:02:58.165563 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-6755d481-c1f2-444f-812b-3bfee400a0b9 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:58.166285 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-6755d481-c1f2-444f-812b-3bfee400a0b9 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:58.169294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:58.174116 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6755d481-c1f2-444f-812b-3bfee400a0b9 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:58.174699 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6755d481-c1f2-444f-812b-3bfee400a0b9 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:58.175119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6755d481-c1f2-444f-812b-3bfee400a0b9 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:58.175817 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6755d481-c1f2-444f-812b-3bfee400a0b9 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:58.176264 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6755d481-c1f2-444f-812b-3bfee400a0b9 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:58.176704 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6755d481-c1f2-444f-812b-3bfee400a0b9 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:58.413587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-4d4da468-31c4-4aec-b050-9a2c7ef35a37 req-6b79fcfb-11c0-4df4-b563-d7882561b231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1777381a-01af-43ba-98dc-31bfeeded7bb", "name": "network-vif-plugged", "status": "completed", "tag": "12b0a8a8-4a84-4e3e-8e96-e6939fe11e18"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:02:58.425709 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-4d4da468-31c4-4aec-b050-9a2c7ef35a37 req-6b79fcfb-11c0-4df4-b563-d7882561b231 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:58.426186 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-4d4da468-31c4-4aec-b050-9a2c7ef35a37 req-6b79fcfb-11c0-4df4-b563-d7882561b231 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:58.426543 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-6755d481-c1f2-444f-812b-3bfee400a0b9 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:58.426970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-4d4da468-31c4-4aec-b050-9a2c7ef35a37 req-6b79fcfb-11c0-4df4-b563-d7882561b231 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:58.437673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-6755d481-c1f2-444f-812b-3bfee400a0b9 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.275870 Sep 15 13:02:58.441747 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-4d4da468-31c4-4aec-b050-9a2c7ef35a37 req-6b79fcfb-11c0-4df4-b563-d7882561b231 service nova] Creating event network-vif-plugged:12b0a8a8-4a84-4e3e-8e96-e6939fe11e18 for instance 1777381a-01af-43ba-98dc-31bfeeded7bb on hv-cinder-83608 Sep 15 13:02:58.446857 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-4d4da468-31c4-4aec-b050-9a2c7ef35a37 req-6b79fcfb-11c0-4df4-b563-d7882561b231 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037780 Sep 15 13:02:58.448072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 192/391] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:02:58.453422 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 200/392] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:58 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:58.481063 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-96f249d4-c49e-4916-847a-47ce82e7e4d2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:58.481767 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-96f249d4-c49e-4916-847a-47ce82e7e4d2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:58.489271 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-96f249d4-c49e-4916-847a-47ce82e7e4d2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:58.489761 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-96f249d4-c49e-4916-847a-47ce82e7e4d2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:58.490394 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-96f249d4-c49e-4916-847a-47ce82e7e4d2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:58.491101 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-96f249d4-c49e-4916-847a-47ce82e7e4d2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:58.491558 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-96f249d4-c49e-4916-847a-47ce82e7e4d2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:58.491981 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-96f249d4-c49e-4916-847a-47ce82e7e4d2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:58.621875 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-96f249d4-c49e-4916-847a-47ce82e7e4d2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:58.630263 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-96f249d4-c49e-4916-847a-47ce82e7e4d2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:58.631647 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-96f249d4-c49e-4916-847a-47ce82e7e4d2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:58.632834 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-96f249d4-c49e-4916-847a-47ce82e7e4d2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1745 microversion: 2.20 time: 0.156060 Sep 15 13:02:58.633397 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 193/393] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:58 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:02:58.744291 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-70e16cbb-f308-4b19-aa3c-07c3dca9d3cc req-6323920f-c194-44e8-9dcd-42a3c86c2e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5170c49a-0d2d-487f-abc1-2cc80ebb31b4", "tag": "a40c3efd-d157-4cf4-9c28-2e3f09f142e7"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:02:58.753876 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-70e16cbb-f308-4b19-aa3c-07c3dca9d3cc req-6323920f-c194-44e8-9dcd-42a3c86c2e52 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:58.754354 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-70e16cbb-f308-4b19-aa3c-07c3dca9d3cc req-6323920f-c194-44e8-9dcd-42a3c86c2e52 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:58.754782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-70e16cbb-f308-4b19-aa3c-07c3dca9d3cc req-6323920f-c194-44e8-9dcd-42a3c86c2e52 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:58.766454 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-70e16cbb-f308-4b19-aa3c-07c3dca9d3cc req-6323920f-c194-44e8-9dcd-42a3c86c2e52 service nova] Creating event network-changed:a40c3efd-d157-4cf4-9c28-2e3f09f142e7 for instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 on hv-cinder-83608 Sep 15 13:02:58.771799 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-70e16cbb-f308-4b19-aa3c-07c3dca9d3cc req-6323920f-c194-44e8-9dcd-42a3c86c2e52 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031192 Sep 15 13:02:58.772449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 201/394] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:02:58.830616 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2e9f9287-8951-4e97-bdf6-8a02313f4dfc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:58.831228 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2e9f9287-8951-4e97-bdf6-8a02313f4dfc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:58.837241 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2e9f9287-8951-4e97-bdf6-8a02313f4dfc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:58.837719 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2e9f9287-8951-4e97-bdf6-8a02313f4dfc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:58.838161 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2e9f9287-8951-4e97-bdf6-8a02313f4dfc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:58.838827 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2e9f9287-8951-4e97-bdf6-8a02313f4dfc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:58.839287 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2e9f9287-8951-4e97-bdf6-8a02313f4dfc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:58.839684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2e9f9287-8951-4e97-bdf6-8a02313f4dfc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:58.858301 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=100 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:58.973511 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2e9f9287-8951-4e97-bdf6-8a02313f4dfc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:58.981728 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2e9f9287-8951-4e97-bdf6-8a02313f4dfc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1720 microversion: 2.1 time: 0.155649 Sep 15 13:02:58.982286 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 194/395] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:58 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:59.462469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8cffd021-1e10-4b8d-8aa1-3a6c010fc66c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:59.463340 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-8cffd021-1e10-4b8d-8aa1-3a6c010fc66c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:59.471760 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8cffd021-1e10-4b8d-8aa1-3a6c010fc66c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:59.472582 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8cffd021-1e10-4b8d-8aa1-3a6c010fc66c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:59.473098 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8cffd021-1e10-4b8d-8aa1-3a6c010fc66c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:59.474027 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8cffd021-1e10-4b8d-8aa1-3a6c010fc66c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:59.474698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8cffd021-1e10-4b8d-8aa1-3a6c010fc66c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:59.475204 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8cffd021-1e10-4b8d-8aa1-3a6c010fc66c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:59.625971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-8cffd021-1e10-4b8d-8aa1-3a6c010fc66c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:59.634070 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8cffd021-1e10-4b8d-8aa1-3a6c010fc66c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.175792 Sep 15 13:02:59.634642 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 202/396] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:02:59 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:02:59.658189 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-84744a33-c7ce-444f-8cce-1c421ac41771 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:02:59.659415 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-84744a33-c7ce-444f-8cce-1c421ac41771 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:02:59.665888 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-84744a33-c7ce-444f-8cce-1c421ac41771 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:59.666370 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-84744a33-c7ce-444f-8cce-1c421ac41771 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:59.666914 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-84744a33-c7ce-444f-8cce-1c421ac41771 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:59.667621 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-84744a33-c7ce-444f-8cce-1c421ac41771 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:02:59.668077 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-84744a33-c7ce-444f-8cce-1c421ac41771 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:02:59.668523 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-84744a33-c7ce-444f-8cce-1c421ac41771 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:02:59.908451 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-84744a33-c7ce-444f-8cce-1c421ac41771 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:59.917193 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-84744a33-c7ce-444f-8cce-1c421ac41771 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:59.919555 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-84744a33-c7ce-444f-8cce-1c421ac41771 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:02:59.921404 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-84744a33-c7ce-444f-8cce-1c421ac41771 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1745 microversion: 2.20 time: 0.267274 Sep 15 13:02:59.922316 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 195/397] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:02:59 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1745 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:00.005118 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-67b3a694-7022-40d9-a4e6-4dd6072a5e46 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:00.005746 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-67b3a694-7022-40d9-a4e6-4dd6072a5e46 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:00.011614 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-67b3a694-7022-40d9-a4e6-4dd6072a5e46 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:00.012043 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-67b3a694-7022-40d9-a4e6-4dd6072a5e46 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:00.012512 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-67b3a694-7022-40d9-a4e6-4dd6072a5e46 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:00.013192 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-67b3a694-7022-40d9-a4e6-4dd6072a5e46 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:00.013636 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-67b3a694-7022-40d9-a4e6-4dd6072a5e46 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:00.014055 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-67b3a694-7022-40d9-a4e6-4dd6072a5e46 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:00.145141 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-67b3a694-7022-40d9-a4e6-4dd6072a5e46 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:00.153300 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-67b3a694-7022-40d9-a4e6-4dd6072a5e46 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1720 microversion: 2.1 time: 0.152091 Sep 15 13:03:00.153863 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 203/398] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:00 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:00.659427 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d0a93906-1a77-4705-af76-42e5f27f2b84 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:00.660065 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d0a93906-1a77-4705-af76-42e5f27f2b84 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:00.666318 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d0a93906-1a77-4705-af76-42e5f27f2b84 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:00.666963 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d0a93906-1a77-4705-af76-42e5f27f2b84 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:00.667496 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d0a93906-1a77-4705-af76-42e5f27f2b84 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:00.668513 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d0a93906-1a77-4705-af76-42e5f27f2b84 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:00.669104 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d0a93906-1a77-4705-af76-42e5f27f2b84 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:00.669648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d0a93906-1a77-4705-af76-42e5f27f2b84 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:00.829686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d0a93906-1a77-4705-af76-42e5f27f2b84 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:00.837691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d0a93906-1a77-4705-af76-42e5f27f2b84 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.184424 Sep 15 13:03:00.838256 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 196/399] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:00 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:00.948948 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a3917183-eaa8-47d9-88e4-1b3ef5f8f251 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:00.950663 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a3917183-eaa8-47d9-88e4-1b3ef5f8f251 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:00.959568 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a3917183-eaa8-47d9-88e4-1b3ef5f8f251 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:00.960096 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a3917183-eaa8-47d9-88e4-1b3ef5f8f251 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:00.960649 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a3917183-eaa8-47d9-88e4-1b3ef5f8f251 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:00.961359 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a3917183-eaa8-47d9-88e4-1b3ef5f8f251 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:00.961814 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a3917183-eaa8-47d9-88e4-1b3ef5f8f251 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:00.962238 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a3917183-eaa8-47d9-88e4-1b3ef5f8f251 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:01.106155 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a3917183-eaa8-47d9-88e4-1b3ef5f8f251 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:01.117657 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a3917183-eaa8-47d9-88e4-1b3ef5f8f251 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:01.119577 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a3917183-eaa8-47d9-88e4-1b3ef5f8f251 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:01.120955 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a3917183-eaa8-47d9-88e4-1b3ef5f8f251 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1740 microversion: 2.20 time: 0.176389 Sep 15 13:03:01.121647 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 204/400] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:00 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:01.178979 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-cce32ff1-5cc4-40d2-8cd1-2d43288b790b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:01.180000 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-cce32ff1-5cc4-40d2-8cd1-2d43288b790b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:01.189261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cce32ff1-5cc4-40d2-8cd1-2d43288b790b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:01.190132 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cce32ff1-5cc4-40d2-8cd1-2d43288b790b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:01.190698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cce32ff1-5cc4-40d2-8cd1-2d43288b790b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:01.191642 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cce32ff1-5cc4-40d2-8cd1-2d43288b790b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:01.192311 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cce32ff1-5cc4-40d2-8cd1-2d43288b790b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:01.192792 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cce32ff1-5cc4-40d2-8cd1-2d43288b790b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:01.360260 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-cce32ff1-5cc4-40d2-8cd1-2d43288b790b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:01.369894 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-cce32ff1-5cc4-40d2-8cd1-2d43288b790b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1720 microversion: 2.1 time: 0.196651 Sep 15 13:03:01.384320 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 197/401] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:01 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:01.862576 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c41d15e4-522d-4e99-99dd-4dea3bda38e2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:01.863355 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c41d15e4-522d-4e99-99dd-4dea3bda38e2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:01.870155 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c41d15e4-522d-4e99-99dd-4dea3bda38e2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:01.870886 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c41d15e4-522d-4e99-99dd-4dea3bda38e2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:01.871492 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c41d15e4-522d-4e99-99dd-4dea3bda38e2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:01.872338 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c41d15e4-522d-4e99-99dd-4dea3bda38e2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:01.872962 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c41d15e4-522d-4e99-99dd-4dea3bda38e2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:01.873390 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c41d15e4-522d-4e99-99dd-4dea3bda38e2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:02.015032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c41d15e4-522d-4e99-99dd-4dea3bda38e2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:02.024356 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c41d15e4-522d-4e99-99dd-4dea3bda38e2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.167064 Sep 15 13:03:02.024937 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 205/402] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:01 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:02.149109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-71e6141a-826b-4346-ad52-77fc18c75f8d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:02.150571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-71e6141a-826b-4346-ad52-77fc18c75f8d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:02.157008 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-71e6141a-826b-4346-ad52-77fc18c75f8d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:02.157861 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-71e6141a-826b-4346-ad52-77fc18c75f8d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:02.158306 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-71e6141a-826b-4346-ad52-77fc18c75f8d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:02.158991 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-71e6141a-826b-4346-ad52-77fc18c75f8d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:02.159621 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-71e6141a-826b-4346-ad52-77fc18c75f8d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:02.160217 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-71e6141a-826b-4346-ad52-77fc18c75f8d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:02.381952 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-71e6141a-826b-4346-ad52-77fc18c75f8d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:02.396751 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a06112ba-5e76-404b-9fe5-633b2976062b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:02.397006 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-71e6141a-826b-4346-ad52-77fc18c75f8d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:02.398089 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a06112ba-5e76-404b-9fe5-633b2976062b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:02.398530 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-71e6141a-826b-4346-ad52-77fc18c75f8d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:02.399723 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-71e6141a-826b-4346-ad52-77fc18c75f8d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1740 microversion: 2.20 time: 0.254624 Sep 15 13:03:02.402876 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 198/403] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:02 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:02.406628 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a06112ba-5e76-404b-9fe5-633b2976062b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:02.407336 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a06112ba-5e76-404b-9fe5-633b2976062b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:02.408242 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a06112ba-5e76-404b-9fe5-633b2976062b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:02.409373 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a06112ba-5e76-404b-9fe5-633b2976062b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:02.410054 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a06112ba-5e76-404b-9fe5-633b2976062b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:02.410637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a06112ba-5e76-404b-9fe5-633b2976062b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:02.553333 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a06112ba-5e76-404b-9fe5-633b2976062b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:02.562636 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a06112ba-5e76-404b-9fe5-633b2976062b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1720 microversion: 2.1 time: 0.171377 Sep 15 13:03:02.563790 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 206/404] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:02 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:02.808626 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-c73646eb-07dd-4234-9c2e-7996bde1c7f4 req-1de26ccf-ce73-4bfb-be77-344394735ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2628b91-c3d5-4bc0-88ed-c6786c051876", "name": "network-vif-plugged", "status": "completed", "tag": "80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:03:02.822753 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-c73646eb-07dd-4234-9c2e-7996bde1c7f4 req-1de26ccf-ce73-4bfb-be77-344394735ccd service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:02.823342 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-c73646eb-07dd-4234-9c2e-7996bde1c7f4 req-1de26ccf-ce73-4bfb-be77-344394735ccd service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:02.823843 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-c73646eb-07dd-4234-9c2e-7996bde1c7f4 req-1de26ccf-ce73-4bfb-be77-344394735ccd service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:02.836548 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-c73646eb-07dd-4234-9c2e-7996bde1c7f4 req-1de26ccf-ce73-4bfb-be77-344394735ccd service nova] Creating event network-vif-plugged:80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80 for instance e2628b91-c3d5-4bc0-88ed-c6786c051876 on hv-cinder-83608 Sep 15 13:03:02.842235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-c73646eb-07dd-4234-9c2e-7996bde1c7f4 req-1de26ccf-ce73-4bfb-be77-344394735ccd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038495 Sep 15 13:03:02.843448 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 199/405] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:03:03.049457 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-20fa5211-52f7-4880-9d9d-3723334214d4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:03.051288 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-20fa5211-52f7-4880-9d9d-3723334214d4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:03.059440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-20fa5211-52f7-4880-9d9d-3723334214d4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:03.060248 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-20fa5211-52f7-4880-9d9d-3723334214d4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:03.060843 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-20fa5211-52f7-4880-9d9d-3723334214d4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:03.062440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-20fa5211-52f7-4880-9d9d-3723334214d4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:03.063255 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-20fa5211-52f7-4880-9d9d-3723334214d4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:03.063919 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-20fa5211-52f7-4880-9d9d-3723334214d4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:03.262210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-20fa5211-52f7-4880-9d9d-3723334214d4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:03.271294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-20fa5211-52f7-4880-9d9d-3723334214d4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.227621 Sep 15 13:03:03.271975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 207/406] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:03 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:03.427472 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6748bfdf-8a64-4956-94c8-b52581f14732 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:03.428182 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6748bfdf-8a64-4956-94c8-b52581f14732 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:03.435352 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6748bfdf-8a64-4956-94c8-b52581f14732 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:03.435849 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6748bfdf-8a64-4956-94c8-b52581f14732 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:03.436669 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6748bfdf-8a64-4956-94c8-b52581f14732 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:03.437971 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6748bfdf-8a64-4956-94c8-b52581f14732 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:03.438998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6748bfdf-8a64-4956-94c8-b52581f14732 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:03.439612 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6748bfdf-8a64-4956-94c8-b52581f14732 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:03.588733 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6748bfdf-8a64-4956-94c8-b52581f14732 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:03.591812 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5f738a7b-761a-48bf-97c9-42b3eac657cd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:03.595542 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-5f738a7b-761a-48bf-97c9-42b3eac657cd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:03.602696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f738a7b-761a-48bf-97c9-42b3eac657cd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:03.603479 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f738a7b-761a-48bf-97c9-42b3eac657cd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:03.604287 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f738a7b-761a-48bf-97c9-42b3eac657cd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:03.604548 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6748bfdf-8a64-4956-94c8-b52581f14732 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:03.606982 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6748bfdf-8a64-4956-94c8-b52581f14732 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:03.608574 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f738a7b-761a-48bf-97c9-42b3eac657cd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:03.608880 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6748bfdf-8a64-4956-94c8-b52581f14732 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1740 microversion: 2.20 time: 0.184970 Sep 15 13:03:03.609613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f738a7b-761a-48bf-97c9-42b3eac657cd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:03.609908 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 200/407] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:03 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:03.610452 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f738a7b-761a-48bf-97c9-42b3eac657cd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:03.789687 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-5f738a7b-761a-48bf-97c9-42b3eac657cd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:03.808919 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-5f738a7b-761a-48bf-97c9-42b3eac657cd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1697 microversion: 2.1 time: 0.224138 Sep 15 13:03:03.809693 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 208/408] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:03 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1697 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:03:03.832773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-527a3543-a4eb-4d80-a426-9cfa0945e7fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:03:03.838869 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-527a3543-a4eb-4d80-a426-9cfa0945e7fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:03.839361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-527a3543-a4eb-4d80-a426-9cfa0945e7fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:03.839797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-527a3543-a4eb-4d80-a426-9cfa0945e7fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:03.907966 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-527a3543-a4eb-4d80-a426-9cfa0945e7fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Going to try to start instance {{(pid=120634) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 15 13:03:03.959586 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-527a3543-a4eb-4d80-a426-9cfa0945e7fb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "POST /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/action" status: 202 len: 0 microversion: 2.1 time: 0.130430 Sep 15 13:03:03.960508 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 201/409] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Sep 15 13:03:03 2022] POST /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:03:03.969412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-78a8b29a-0a1e-4743-8ee0-b3cef488d73a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:03.970275 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-78a8b29a-0a1e-4743-8ee0-b3cef488d73a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:03.976632 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-78a8b29a-0a1e-4743-8ee0-b3cef488d73a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:03.978205 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-78a8b29a-0a1e-4743-8ee0-b3cef488d73a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:03.978704 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-78a8b29a-0a1e-4743-8ee0-b3cef488d73a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:03.979590 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-78a8b29a-0a1e-4743-8ee0-b3cef488d73a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:03.980050 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-78a8b29a-0a1e-4743-8ee0-b3cef488d73a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:03.980496 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-78a8b29a-0a1e-4743-8ee0-b3cef488d73a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:04.144683 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-78a8b29a-0a1e-4743-8ee0-b3cef488d73a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:04.157004 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-78a8b29a-0a1e-4743-8ee0-b3cef488d73a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1706 microversion: 2.1 time: 0.192139 Sep 15 13:03:04.158134 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 209/410] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:03 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1706 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:04.295425 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b94fa990-2be3-41f9-a373-5e0ab71570c2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:04.296632 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b94fa990-2be3-41f9-a373-5e0ab71570c2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:04.303289 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b94fa990-2be3-41f9-a373-5e0ab71570c2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:04.304060 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b94fa990-2be3-41f9-a373-5e0ab71570c2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:04.304940 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b94fa990-2be3-41f9-a373-5e0ab71570c2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:04.305949 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b94fa990-2be3-41f9-a373-5e0ab71570c2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:04.306402 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b94fa990-2be3-41f9-a373-5e0ab71570c2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:04.307127 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b94fa990-2be3-41f9-a373-5e0ab71570c2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:04.473750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b94fa990-2be3-41f9-a373-5e0ab71570c2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:04.485035 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b94fa990-2be3-41f9-a373-5e0ab71570c2 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1261 microversion: 2.1 time: 0.193866 Sep 15 13:03:04.488176 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 202/411] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:04 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1261 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:04.636607 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e15ae5f9-399b-4682-829f-24016a4b6aa0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:04.637341 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e15ae5f9-399b-4682-829f-24016a4b6aa0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:04.645188 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e15ae5f9-399b-4682-829f-24016a4b6aa0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:04.646005 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e15ae5f9-399b-4682-829f-24016a4b6aa0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:04.646673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e15ae5f9-399b-4682-829f-24016a4b6aa0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:04.647444 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e15ae5f9-399b-4682-829f-24016a4b6aa0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:04.647968 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e15ae5f9-399b-4682-829f-24016a4b6aa0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:04.648494 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e15ae5f9-399b-4682-829f-24016a4b6aa0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:04.825418 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e15ae5f9-399b-4682-829f-24016a4b6aa0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:04.835369 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e15ae5f9-399b-4682-829f-24016a4b6aa0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:04.837834 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e15ae5f9-399b-4682-829f-24016a4b6aa0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:04.839318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e15ae5f9-399b-4682-829f-24016a4b6aa0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1740 microversion: 2.20 time: 0.206688 Sep 15 13:03:04.840202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 210/412] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:04 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:05.180792 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8fd6e8d7-dcd9-4bb7-ae69-701ebec7b74f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:05.181416 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8fd6e8d7-dcd9-4bb7-ae69-701ebec7b74f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:05.188173 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8fd6e8d7-dcd9-4bb7-ae69-701ebec7b74f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:05.188687 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8fd6e8d7-dcd9-4bb7-ae69-701ebec7b74f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:05.189119 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8fd6e8d7-dcd9-4bb7-ae69-701ebec7b74f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:05.189850 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8fd6e8d7-dcd9-4bb7-ae69-701ebec7b74f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:05.190300 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8fd6e8d7-dcd9-4bb7-ae69-701ebec7b74f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:05.190873 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8fd6e8d7-dcd9-4bb7-ae69-701ebec7b74f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:05.443844 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8fd6e8d7-dcd9-4bb7-ae69-701ebec7b74f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:05.453387 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8fd6e8d7-dcd9-4bb7-ae69-701ebec7b74f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1706 microversion: 2.1 time: 0.276591 Sep 15 13:03:05.470298 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 203/413] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:05 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1706 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:05.510523 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-6f4f4fcf-ab64-4888-800e-18476fca5dc3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:05.511125 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-6f4f4fcf-ab64-4888-800e-18476fca5dc3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:05.517919 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6f4f4fcf-ab64-4888-800e-18476fca5dc3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:05.518675 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6f4f4fcf-ab64-4888-800e-18476fca5dc3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:05.519113 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6f4f4fcf-ab64-4888-800e-18476fca5dc3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:05.519823 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6f4f4fcf-ab64-4888-800e-18476fca5dc3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:05.520364 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6f4f4fcf-ab64-4888-800e-18476fca5dc3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:05.520738 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6f4f4fcf-ab64-4888-800e-18476fca5dc3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:05.670832 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-6f4f4fcf-ab64-4888-800e-18476fca5dc3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:05.679264 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-6f4f4fcf-ab64-4888-800e-18476fca5dc3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1446 microversion: 2.1 time: 0.172567 Sep 15 13:03:05.679830 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 211/414] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:05 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1446 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:05.703852 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fab84913-5edf-48d6-a812-06dea3e0eda5 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:05.704497 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-fab84913-5edf-48d6-a812-06dea3e0eda5 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:05.711266 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fab84913-5edf-48d6-a812-06dea3e0eda5 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:05.711755 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fab84913-5edf-48d6-a812-06dea3e0eda5 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:05.712188 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fab84913-5edf-48d6-a812-06dea3e0eda5 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:05.713607 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fab84913-5edf-48d6-a812-06dea3e0eda5 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:05.714066 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fab84913-5edf-48d6-a812-06dea3e0eda5 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:05.714488 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fab84913-5edf-48d6-a812-06dea3e0eda5 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:05.857326 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-fab84913-5edf-48d6-a812-06dea3e0eda5 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:05.867816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-fab84913-5edf-48d6-a812-06dea3e0eda5 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1446 microversion: 2.1 time: 0.167915 Sep 15 13:03:05.868478 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2bd805dd-9020-42b3-bf80-663835d77f68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:05.869252 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 204/415] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:05 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1446 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:05.869675 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2bd805dd-9020-42b3-bf80-663835d77f68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:05.877464 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2bd805dd-9020-42b3-bf80-663835d77f68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:05.878062 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2bd805dd-9020-42b3-bf80-663835d77f68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:05.878600 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2bd805dd-9020-42b3-bf80-663835d77f68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:05.879375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2bd805dd-9020-42b3-bf80-663835d77f68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:05.879920 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2bd805dd-9020-42b3-bf80-663835d77f68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:05.880444 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2bd805dd-9020-42b3-bf80-663835d77f68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:06.052096 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2bd805dd-9020-42b3-bf80-663835d77f68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:06.065565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2bd805dd-9020-42b3-bf80-663835d77f68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:06.067318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2bd805dd-9020-42b3-bf80-663835d77f68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:06.069436 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2bd805dd-9020-42b3-bf80-663835d77f68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1740 microversion: 2.20 time: 0.206260 Sep 15 13:03:06.084298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 212/416] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:05 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:03:06.478290 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fa06ecba-84ca-46cf-9750-ddd93fbb64d9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:06.479098 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-fa06ecba-84ca-46cf-9750-ddd93fbb64d9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:06.488194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fa06ecba-84ca-46cf-9750-ddd93fbb64d9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:06.490823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fa06ecba-84ca-46cf-9750-ddd93fbb64d9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:06.491476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fa06ecba-84ca-46cf-9750-ddd93fbb64d9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:06.494248 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fa06ecba-84ca-46cf-9750-ddd93fbb64d9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:06.494728 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fa06ecba-84ca-46cf-9750-ddd93fbb64d9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:06.495488 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fa06ecba-84ca-46cf-9750-ddd93fbb64d9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:06.768754 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-fa06ecba-84ca-46cf-9750-ddd93fbb64d9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:06.792865 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-fa06ecba-84ca-46cf-9750-ddd93fbb64d9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1706 microversion: 2.1 time: 0.318422 Sep 15 13:03:06.793749 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 205/417] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:06 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1706 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:07.103441 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3fbd3052-ce21-4ad1-bbaf-6d715ff6b1d9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:07.104689 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3fbd3052-ce21-4ad1-bbaf-6d715ff6b1d9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:07.111844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3fbd3052-ce21-4ad1-bbaf-6d715ff6b1d9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:07.112357 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3fbd3052-ce21-4ad1-bbaf-6d715ff6b1d9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:07.112988 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3fbd3052-ce21-4ad1-bbaf-6d715ff6b1d9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:07.113866 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3fbd3052-ce21-4ad1-bbaf-6d715ff6b1d9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:07.114479 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3fbd3052-ce21-4ad1-bbaf-6d715ff6b1d9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:07.114903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3fbd3052-ce21-4ad1-bbaf-6d715ff6b1d9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:07.294868 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3fbd3052-ce21-4ad1-bbaf-6d715ff6b1d9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:07.307032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3fbd3052-ce21-4ad1-bbaf-6d715ff6b1d9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:07.308749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3fbd3052-ce21-4ad1-bbaf-6d715ff6b1d9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:07.310480 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3fbd3052-ce21-4ad1-bbaf-6d715ff6b1d9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1740 microversion: 2.20 time: 0.217650 Sep 15 13:03:07.311866 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 213/418] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:07 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:03:07.825544 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b310305f-7c92-465b-8b32-aacbbf1b545f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:07.827451 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b310305f-7c92-465b-8b32-aacbbf1b545f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:07.839208 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b310305f-7c92-465b-8b32-aacbbf1b545f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:07.839711 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b310305f-7c92-465b-8b32-aacbbf1b545f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:07.840147 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b310305f-7c92-465b-8b32-aacbbf1b545f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:07.845641 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b310305f-7c92-465b-8b32-aacbbf1b545f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:07.846136 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b310305f-7c92-465b-8b32-aacbbf1b545f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:07.846749 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b310305f-7c92-465b-8b32-aacbbf1b545f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:08.096780 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b310305f-7c92-465b-8b32-aacbbf1b545f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:08.111342 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b310305f-7c92-465b-8b32-aacbbf1b545f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1710 microversion: 2.1 time: 0.293408 Sep 15 13:03:08.112324 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 206/419] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:07 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1710 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:08.340145 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3dce1ef5-527e-4771-82dd-a35439f76482 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:08.341392 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3dce1ef5-527e-4771-82dd-a35439f76482 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:08.350591 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3dce1ef5-527e-4771-82dd-a35439f76482 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:08.351346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3dce1ef5-527e-4771-82dd-a35439f76482 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:08.351944 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3dce1ef5-527e-4771-82dd-a35439f76482 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:08.352872 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3dce1ef5-527e-4771-82dd-a35439f76482 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:08.354000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3dce1ef5-527e-4771-82dd-a35439f76482 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:08.354689 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3dce1ef5-527e-4771-82dd-a35439f76482 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:08.461950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-07a5f4a9-6ee9-4253-8ee0-a13d82dcac0f req-fb26d9cb-41a9-44ea-af43-d079301aa5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2628b91-c3d5-4bc0-88ed-c6786c051876", "tag": "80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:03:08.474987 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-07a5f4a9-6ee9-4253-8ee0-a13d82dcac0f req-fb26d9cb-41a9-44ea-af43-d079301aa5d9 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:08.477414 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-07a5f4a9-6ee9-4253-8ee0-a13d82dcac0f req-fb26d9cb-41a9-44ea-af43-d079301aa5d9 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:08.477945 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-07a5f4a9-6ee9-4253-8ee0-a13d82dcac0f req-fb26d9cb-41a9-44ea-af43-d079301aa5d9 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:08.497105 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-07a5f4a9-6ee9-4253-8ee0-a13d82dcac0f req-fb26d9cb-41a9-44ea-af43-d079301aa5d9 service nova] Creating event network-changed:80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80 for instance e2628b91-c3d5-4bc0-88ed-c6786c051876 on hv-cinder-83608 Sep 15 13:03:08.523893 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-07a5f4a9-6ee9-4253-8ee0-a13d82dcac0f req-fb26d9cb-41a9-44ea-af43-d079301aa5d9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047287 Sep 15 13:03:08.527797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 207/420] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:03:08.580011 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3dce1ef5-527e-4771-82dd-a35439f76482 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:08.591822 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3dce1ef5-527e-4771-82dd-a35439f76482 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:08.594795 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3dce1ef5-527e-4771-82dd-a35439f76482 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:08.596221 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3dce1ef5-527e-4771-82dd-a35439f76482 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1740 microversion: 2.20 time: 0.261850 Sep 15 13:03:08.597010 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 214/421] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:08 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:09.624285 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1ce10ba6-9c28-412a-8df3-50e6af0062e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:09.624996 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1ce10ba6-9c28-412a-8df3-50e6af0062e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:09.632055 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1ce10ba6-9c28-412a-8df3-50e6af0062e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:09.632569 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1ce10ba6-9c28-412a-8df3-50e6af0062e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:09.633007 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1ce10ba6-9c28-412a-8df3-50e6af0062e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:09.633700 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1ce10ba6-9c28-412a-8df3-50e6af0062e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:09.634387 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1ce10ba6-9c28-412a-8df3-50e6af0062e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:09.634978 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1ce10ba6-9c28-412a-8df3-50e6af0062e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:09.794818 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1ce10ba6-9c28-412a-8df3-50e6af0062e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:09.807340 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1ce10ba6-9c28-412a-8df3-50e6af0062e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:09.809012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1ce10ba6-9c28-412a-8df3-50e6af0062e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:09.810266 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1ce10ba6-9c28-412a-8df3-50e6af0062e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1740 microversion: 2.20 time: 0.190961 Sep 15 13:03:09.812313 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 208/422] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:09 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:10.837562 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d191ac0c-9561-49bf-9602-b0d88cc73543 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:10.838315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d191ac0c-9561-49bf-9602-b0d88cc73543 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:10.847928 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d191ac0c-9561-49bf-9602-b0d88cc73543 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:10.848868 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d191ac0c-9561-49bf-9602-b0d88cc73543 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:10.849571 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d191ac0c-9561-49bf-9602-b0d88cc73543 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:10.850286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d191ac0c-9561-49bf-9602-b0d88cc73543 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:10.851096 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d191ac0c-9561-49bf-9602-b0d88cc73543 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:10.852057 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d191ac0c-9561-49bf-9602-b0d88cc73543 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:10.988970 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d191ac0c-9561-49bf-9602-b0d88cc73543 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:10.997142 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d191ac0c-9561-49bf-9602-b0d88cc73543 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:10.998659 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d191ac0c-9561-49bf-9602-b0d88cc73543 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:10.999826 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d191ac0c-9561-49bf-9602-b0d88cc73543 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1740 microversion: 2.20 time: 0.166219 Sep 15 13:03:11.000407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 215/423] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:10 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:12.025489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a2e8e430-e500-42ab-90e6-1e50d5906e38 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:12.026097 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a2e8e430-e500-42ab-90e6-1e50d5906e38 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:12.032819 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a2e8e430-e500-42ab-90e6-1e50d5906e38 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:12.033298 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a2e8e430-e500-42ab-90e6-1e50d5906e38 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:12.033757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a2e8e430-e500-42ab-90e6-1e50d5906e38 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:12.034589 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a2e8e430-e500-42ab-90e6-1e50d5906e38 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:12.035048 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a2e8e430-e500-42ab-90e6-1e50d5906e38 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:12.035465 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a2e8e430-e500-42ab-90e6-1e50d5906e38 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:12.246100 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a2e8e430-e500-42ab-90e6-1e50d5906e38 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:12.254824 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a2e8e430-e500-42ab-90e6-1e50d5906e38 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:12.256588 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a2e8e430-e500-42ab-90e6-1e50d5906e38 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:12.257760 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a2e8e430-e500-42ab-90e6-1e50d5906e38 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1722 microversion: 2.20 time: 0.236395 Sep 15 13:03:12.258318 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 209/424] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:12 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:13.284411 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d21468a4-5e99-44bf-9538-99e42c1dc2da tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:13.285016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d21468a4-5e99-44bf-9538-99e42c1dc2da tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:13.291494 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d21468a4-5e99-44bf-9538-99e42c1dc2da tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:13.291968 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d21468a4-5e99-44bf-9538-99e42c1dc2da tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:13.292420 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d21468a4-5e99-44bf-9538-99e42c1dc2da tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:13.293101 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d21468a4-5e99-44bf-9538-99e42c1dc2da tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:13.293542 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d21468a4-5e99-44bf-9538-99e42c1dc2da tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:13.293956 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d21468a4-5e99-44bf-9538-99e42c1dc2da tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:13.426595 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d21468a4-5e99-44bf-9538-99e42c1dc2da tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:13.430080 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=100 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:03:13.435855 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d21468a4-5e99-44bf-9538-99e42c1dc2da tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:13.437335 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d21468a4-5e99-44bf-9538-99e42c1dc2da tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:13.438637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d21468a4-5e99-44bf-9538-99e42c1dc2da tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1722 microversion: 2.20 time: 0.158596 Sep 15 13:03:13.439198 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 216/425] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:13 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:14.464196 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b48c55ff-2648-4b6d-a962-b7a64ecde4ac tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:14.464910 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b48c55ff-2648-4b6d-a962-b7a64ecde4ac tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:14.471538 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b48c55ff-2648-4b6d-a962-b7a64ecde4ac tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:14.472108 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b48c55ff-2648-4b6d-a962-b7a64ecde4ac tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:14.472628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b48c55ff-2648-4b6d-a962-b7a64ecde4ac tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:14.473413 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b48c55ff-2648-4b6d-a962-b7a64ecde4ac tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:14.473868 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b48c55ff-2648-4b6d-a962-b7a64ecde4ac tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:14.474594 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b48c55ff-2648-4b6d-a962-b7a64ecde4ac tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:14.606739 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b48c55ff-2648-4b6d-a962-b7a64ecde4ac tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:14.615124 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b48c55ff-2648-4b6d-a962-b7a64ecde4ac tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:14.616757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b48c55ff-2648-4b6d-a962-b7a64ecde4ac tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:14.617861 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b48c55ff-2648-4b6d-a962-b7a64ecde4ac tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1722 microversion: 2.20 time: 0.157565 Sep 15 13:03:14.618420 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 210/426] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:14 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:15.644407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-919c917b-d39f-454b-bf25-18672ef4f141 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:15.645017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-919c917b-d39f-454b-bf25-18672ef4f141 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:15.651913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-919c917b-d39f-454b-bf25-18672ef4f141 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:15.652365 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-919c917b-d39f-454b-bf25-18672ef4f141 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:15.652802 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-919c917b-d39f-454b-bf25-18672ef4f141 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:15.653518 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-919c917b-d39f-454b-bf25-18672ef4f141 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:15.653968 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-919c917b-d39f-454b-bf25-18672ef4f141 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:15.654390 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-919c917b-d39f-454b-bf25-18672ef4f141 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:15.793786 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-919c917b-d39f-454b-bf25-18672ef4f141 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:15.802105 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-919c917b-d39f-454b-bf25-18672ef4f141 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:15.803536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-919c917b-d39f-454b-bf25-18672ef4f141 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:15.804701 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-919c917b-d39f-454b-bf25-18672ef4f141 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1665 microversion: 2.20 time: 0.164482 Sep 15 13:03:15.805258 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 217/427] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:15 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:15.830187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a76f5ecc-d115-4613-b3c8-897698899668 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4327263-b709-486a-b876-9c91b8ff87e8"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:03:15.832573 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a76f5ecc-d115-4613-b3c8-897698899668 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:15.838481 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a76f5ecc-d115-4613-b3c8-897698899668 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:15.838969 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a76f5ecc-d115-4613-b3c8-897698899668 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:15.839411 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a76f5ecc-d115-4613-b3c8-897698899668 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:15.840099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a76f5ecc-d115-4613-b3c8-897698899668 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:15.840586 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a76f5ecc-d115-4613-b3c8-897698899668 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:15.841013 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a76f5ecc-d115-4613-b3c8-897698899668 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:15.859743 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:03:16.129056 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a76f5ecc-d115-4613-b3c8-897698899668 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "POST /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303488 Sep 15 13:03:16.129672 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 211/428] 10.222.0.57 () {62 vars in 1364 bytes} [Thu Sep 15 13:03:15 2022] POST /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 13:03:16.256810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f01a0c05-418e-4c20-8187-bee033cb1819 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:03:16.257407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f01a0c05-418e-4c20-8187-bee033cb1819 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:16.263275 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f01a0c05-418e-4c20-8187-bee033cb1819 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:16.263788 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f01a0c05-418e-4c20-8187-bee033cb1819 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:16.264261 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f01a0c05-418e-4c20-8187-bee033cb1819 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:16.264969 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f01a0c05-418e-4c20-8187-bee033cb1819 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:16.265416 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f01a0c05-418e-4c20-8187-bee033cb1819 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:16.265837 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f01a0c05-418e-4c20-8187-bee033cb1819 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:16.307867 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f01a0c05-418e-4c20-8187-bee033cb1819 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120633) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 13:03:16.375004 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f01a0c05-418e-4c20-8187-bee033cb1819 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "POST /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/action" status: 202 len: 0 microversion: 2.20 time: 0.122074 Sep 15 13:03:16.375957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 218/429] 10.222.0.57 () {62 vars in 1319 bytes} [Thu Sep 15 13:03:16 2022] POST /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:03:16.383836 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-16dd6932-4422-445d-b5db-367548aa9466 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:16.384567 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-16dd6932-4422-445d-b5db-367548aa9466 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:16.392012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-16dd6932-4422-445d-b5db-367548aa9466 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:16.392607 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-16dd6932-4422-445d-b5db-367548aa9466 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:16.393101 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-16dd6932-4422-445d-b5db-367548aa9466 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:16.394133 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-16dd6932-4422-445d-b5db-367548aa9466 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:16.394658 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-16dd6932-4422-445d-b5db-367548aa9466 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:16.395170 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-16dd6932-4422-445d-b5db-367548aa9466 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:16.531884 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-16dd6932-4422-445d-b5db-367548aa9466 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:16.540481 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-16dd6932-4422-445d-b5db-367548aa9466 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:16.542005 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-16dd6932-4422-445d-b5db-367548aa9466 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:16.543150 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-16dd6932-4422-445d-b5db-367548aa9466 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1751 microversion: 2.20 time: 0.163236 Sep 15 13:03:16.543696 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 212/430] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:16 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:16.761032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-ccf90c7c-35f1-4619-9f69-f67b248d275d req-1e47554f-fc05-48ee-8cbc-9dad1dedfb14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1777381a-01af-43ba-98dc-31bfeeded7bb", "name": "network-vif-unplugged", "status": "completed", "tag": "12b0a8a8-4a84-4e3e-8e96-e6939fe11e18"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:03:16.772107 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-ccf90c7c-35f1-4619-9f69-f67b248d275d req-1e47554f-fc05-48ee-8cbc-9dad1dedfb14 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:16.772708 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-ccf90c7c-35f1-4619-9f69-f67b248d275d req-1e47554f-fc05-48ee-8cbc-9dad1dedfb14 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:16.773743 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-ccf90c7c-35f1-4619-9f69-f67b248d275d req-1e47554f-fc05-48ee-8cbc-9dad1dedfb14 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:16.788323 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.compute.server_external_events [req-ccf90c7c-35f1-4619-9f69-f67b248d275d req-1e47554f-fc05-48ee-8cbc-9dad1dedfb14 service nova] Unable to find a host for instance 1777381a-01af-43ba-98dc-31bfeeded7bb. Dropping event network-vif-unplugged {{(pid=120633) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 15 13:03:16.789203 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-ccf90c7c-35f1-4619-9f69-f67b248d275d req-1e47554f-fc05-48ee-8cbc-9dad1dedfb14 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032633 Sep 15 13:03:16.789955 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 219/431] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 15 13:03:17.568917 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-844983d2-1d5d-4555-b044-ab8421aefce3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:17.569525 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-844983d2-1d5d-4555-b044-ab8421aefce3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:17.575332 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-844983d2-1d5d-4555-b044-ab8421aefce3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:17.575812 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-844983d2-1d5d-4555-b044-ab8421aefce3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:17.576242 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-844983d2-1d5d-4555-b044-ab8421aefce3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:17.577743 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-844983d2-1d5d-4555-b044-ab8421aefce3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:17.578201 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-844983d2-1d5d-4555-b044-ab8421aefce3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:17.578620 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-844983d2-1d5d-4555-b044-ab8421aefce3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:17.712159 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-844983d2-1d5d-4555-b044-ab8421aefce3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:17.720679 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-844983d2-1d5d-4555-b044-ab8421aefce3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:17.722108 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-844983d2-1d5d-4555-b044-ab8421aefce3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:17.723259 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-844983d2-1d5d-4555-b044-ab8421aefce3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1753 microversion: 2.20 time: 0.158185 Sep 15 13:03:17.723825 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 213/432] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:17 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:18.749274 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-28e2ca54-3b00-43a1-9682-ef0f952ec583 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:18.749884 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-28e2ca54-3b00-43a1-9682-ef0f952ec583 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:18.756238 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28e2ca54-3b00-43a1-9682-ef0f952ec583 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:18.756842 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28e2ca54-3b00-43a1-9682-ef0f952ec583 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:18.757273 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28e2ca54-3b00-43a1-9682-ef0f952ec583 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:18.758014 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28e2ca54-3b00-43a1-9682-ef0f952ec583 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:18.758465 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28e2ca54-3b00-43a1-9682-ef0f952ec583 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:18.758880 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28e2ca54-3b00-43a1-9682-ef0f952ec583 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:18.888324 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-28e2ca54-3b00-43a1-9682-ef0f952ec583 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:18.897997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-28e2ca54-3b00-43a1-9682-ef0f952ec583 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:18.899442 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-28e2ca54-3b00-43a1-9682-ef0f952ec583 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:18.900621 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-28e2ca54-3b00-43a1-9682-ef0f952ec583 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.155444 Sep 15 13:03:18.901182 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 220/433] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:18 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:03:19.926136 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8255fd19-3fbe-4a38-ae45-dfd29554b9fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:19.926746 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8255fd19-3fbe-4a38-ae45-dfd29554b9fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:19.933027 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8255fd19-3fbe-4a38-ae45-dfd29554b9fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:19.933510 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8255fd19-3fbe-4a38-ae45-dfd29554b9fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:19.933939 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8255fd19-3fbe-4a38-ae45-dfd29554b9fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:19.934630 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8255fd19-3fbe-4a38-ae45-dfd29554b9fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:19.935074 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8255fd19-3fbe-4a38-ae45-dfd29554b9fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:19.936179 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8255fd19-3fbe-4a38-ae45-dfd29554b9fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:20.101991 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8255fd19-3fbe-4a38-ae45-dfd29554b9fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:20.118046 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8255fd19-3fbe-4a38-ae45-dfd29554b9fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:20.121191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8255fd19-3fbe-4a38-ae45-dfd29554b9fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:20.122995 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8255fd19-3fbe-4a38-ae45-dfd29554b9fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.200882 Sep 15 13:03:20.125004 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 214/434] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:19 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:21.149745 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-72ae0fae-de0c-4b7b-9de6-ad535c6ae157 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:21.150357 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-72ae0fae-de0c-4b7b-9de6-ad535c6ae157 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:21.157337 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-72ae0fae-de0c-4b7b-9de6-ad535c6ae157 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:21.157825 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-72ae0fae-de0c-4b7b-9de6-ad535c6ae157 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:21.158256 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-72ae0fae-de0c-4b7b-9de6-ad535c6ae157 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:21.158957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-72ae0fae-de0c-4b7b-9de6-ad535c6ae157 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:21.159406 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-72ae0fae-de0c-4b7b-9de6-ad535c6ae157 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:21.159828 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-72ae0fae-de0c-4b7b-9de6-ad535c6ae157 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:21.297009 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-72ae0fae-de0c-4b7b-9de6-ad535c6ae157 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:21.305938 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-72ae0fae-de0c-4b7b-9de6-ad535c6ae157 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:21.307653 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-72ae0fae-de0c-4b7b-9de6-ad535c6ae157 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:21.308854 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-72ae0fae-de0c-4b7b-9de6-ad535c6ae157 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.163069 Sep 15 13:03:21.309405 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 221/435] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:21 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:22.334240 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-89124d4d-6d12-4b35-a2c8-107119cccddc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:22.334827 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-89124d4d-6d12-4b35-a2c8-107119cccddc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:22.340994 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89124d4d-6d12-4b35-a2c8-107119cccddc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:22.341476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89124d4d-6d12-4b35-a2c8-107119cccddc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:22.341938 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89124d4d-6d12-4b35-a2c8-107119cccddc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:22.343021 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89124d4d-6d12-4b35-a2c8-107119cccddc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:22.343467 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89124d4d-6d12-4b35-a2c8-107119cccddc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:22.343888 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89124d4d-6d12-4b35-a2c8-107119cccddc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:22.479405 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-89124d4d-6d12-4b35-a2c8-107119cccddc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:22.492847 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-89124d4d-6d12-4b35-a2c8-107119cccddc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:22.494292 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-89124d4d-6d12-4b35-a2c8-107119cccddc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:22.495487 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-89124d4d-6d12-4b35-a2c8-107119cccddc tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.165131 Sep 15 13:03:22.496048 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 215/436] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:22 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:03:23.521080 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bff27edd-6417-4f35-aadc-4d3ede23d9fb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:23.521757 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-bff27edd-6417-4f35-aadc-4d3ede23d9fb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:23.528232 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bff27edd-6417-4f35-aadc-4d3ede23d9fb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:23.528750 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bff27edd-6417-4f35-aadc-4d3ede23d9fb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:23.529181 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bff27edd-6417-4f35-aadc-4d3ede23d9fb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:23.529960 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bff27edd-6417-4f35-aadc-4d3ede23d9fb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:23.530331 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bff27edd-6417-4f35-aadc-4d3ede23d9fb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:23.530752 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bff27edd-6417-4f35-aadc-4d3ede23d9fb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:23.669579 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-bff27edd-6417-4f35-aadc-4d3ede23d9fb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:23.678662 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-bff27edd-6417-4f35-aadc-4d3ede23d9fb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:23.680121 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-bff27edd-6417-4f35-aadc-4d3ede23d9fb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:23.681319 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-bff27edd-6417-4f35-aadc-4d3ede23d9fb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.164396 Sep 15 13:03:23.681884 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 222/437] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:23 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:24.707981 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-082e6dbc-5519-47bc-97dc-02ff2d66bee9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:24.708614 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-082e6dbc-5519-47bc-97dc-02ff2d66bee9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:24.714854 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-082e6dbc-5519-47bc-97dc-02ff2d66bee9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:24.715340 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-082e6dbc-5519-47bc-97dc-02ff2d66bee9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:24.715778 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-082e6dbc-5519-47bc-97dc-02ff2d66bee9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:24.716498 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-082e6dbc-5519-47bc-97dc-02ff2d66bee9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:24.721004 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-082e6dbc-5519-47bc-97dc-02ff2d66bee9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:24.721484 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-082e6dbc-5519-47bc-97dc-02ff2d66bee9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:24.865457 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-082e6dbc-5519-47bc-97dc-02ff2d66bee9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:24.875484 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-082e6dbc-5519-47bc-97dc-02ff2d66bee9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:24.876956 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-082e6dbc-5519-47bc-97dc-02ff2d66bee9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:24.878333 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-082e6dbc-5519-47bc-97dc-02ff2d66bee9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.174333 Sep 15 13:03:24.878893 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 216/438] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:24 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:25.904636 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-78b55168-87d0-4310-9501-c7a8c7d5b592 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:25.905782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-78b55168-87d0-4310-9501-c7a8c7d5b592 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:25.912013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-78b55168-87d0-4310-9501-c7a8c7d5b592 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:25.912531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-78b55168-87d0-4310-9501-c7a8c7d5b592 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:25.912960 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-78b55168-87d0-4310-9501-c7a8c7d5b592 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:25.913646 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-78b55168-87d0-4310-9501-c7a8c7d5b592 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:25.914120 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-78b55168-87d0-4310-9501-c7a8c7d5b592 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:25.914537 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-78b55168-87d0-4310-9501-c7a8c7d5b592 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:26.061920 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-78b55168-87d0-4310-9501-c7a8c7d5b592 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:26.071004 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-78b55168-87d0-4310-9501-c7a8c7d5b592 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:26.072440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-78b55168-87d0-4310-9501-c7a8c7d5b592 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:26.073612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-78b55168-87d0-4310-9501-c7a8c7d5b592 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.173006 Sep 15 13:03:26.074173 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 223/439] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:25 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:27.102424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6b3f26ae-e0ce-48c3-851b-f13967018e8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:27.103036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6b3f26ae-e0ce-48c3-851b-f13967018e8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:27.110161 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b3f26ae-e0ce-48c3-851b-f13967018e8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:27.110655 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b3f26ae-e0ce-48c3-851b-f13967018e8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:27.111091 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b3f26ae-e0ce-48c3-851b-f13967018e8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:27.111805 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b3f26ae-e0ce-48c3-851b-f13967018e8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:27.112257 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b3f26ae-e0ce-48c3-851b-f13967018e8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:27.112709 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b3f26ae-e0ce-48c3-851b-f13967018e8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:27.306764 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6b3f26ae-e0ce-48c3-851b-f13967018e8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:27.316791 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6b3f26ae-e0ce-48c3-851b-f13967018e8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:27.318227 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6b3f26ae-e0ce-48c3-851b-f13967018e8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:27.319394 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6b3f26ae-e0ce-48c3-851b-f13967018e8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.222717 Sep 15 13:03:27.319953 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 217/440] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:27 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:03:28.345780 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2f0516a0-a8c1-4a06-86dc-58299ada5d1f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:28.346455 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2f0516a0-a8c1-4a06-86dc-58299ada5d1f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:28.348767 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:03:28.354161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2f0516a0-a8c1-4a06-86dc-58299ada5d1f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:28.354574 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2f0516a0-a8c1-4a06-86dc-58299ada5d1f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:28.355013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2f0516a0-a8c1-4a06-86dc-58299ada5d1f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:28.355709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2f0516a0-a8c1-4a06-86dc-58299ada5d1f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:28.356160 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2f0516a0-a8c1-4a06-86dc-58299ada5d1f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:28.356601 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2f0516a0-a8c1-4a06-86dc-58299ada5d1f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:28.544329 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2f0516a0-a8c1-4a06-86dc-58299ada5d1f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:28.554643 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2f0516a0-a8c1-4a06-86dc-58299ada5d1f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:28.556487 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2f0516a0-a8c1-4a06-86dc-58299ada5d1f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:28.557877 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2f0516a0-a8c1-4a06-86dc-58299ada5d1f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.216058 Sep 15 13:03:28.558629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 224/441] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:28 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:29.583807 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ad84757f-1df3-44a5-a468-379e59bc2907 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:29.584482 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ad84757f-1df3-44a5-a468-379e59bc2907 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:29.586632 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=54 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:03:29.593245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ad84757f-1df3-44a5-a468-379e59bc2907 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:29.593754 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ad84757f-1df3-44a5-a468-379e59bc2907 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:29.594177 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ad84757f-1df3-44a5-a468-379e59bc2907 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:29.594958 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ad84757f-1df3-44a5-a468-379e59bc2907 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:29.595412 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ad84757f-1df3-44a5-a468-379e59bc2907 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:29.595832 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ad84757f-1df3-44a5-a468-379e59bc2907 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:29.736898 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ad84757f-1df3-44a5-a468-379e59bc2907 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:29.745616 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ad84757f-1df3-44a5-a468-379e59bc2907 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:29.747058 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ad84757f-1df3-44a5-a468-379e59bc2907 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:29.748875 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ad84757f-1df3-44a5-a468-379e59bc2907 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.168359 Sep 15 13:03:29.749643 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 218/442] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:29 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:30.775405 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-67c30b81-0f40-4a1c-8f8f-ccbde6245e14 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:30.776016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-67c30b81-0f40-4a1c-8f8f-ccbde6245e14 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:30.783131 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-67c30b81-0f40-4a1c-8f8f-ccbde6245e14 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:30.783612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-67c30b81-0f40-4a1c-8f8f-ccbde6245e14 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:30.784044 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-67c30b81-0f40-4a1c-8f8f-ccbde6245e14 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:30.784759 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-67c30b81-0f40-4a1c-8f8f-ccbde6245e14 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:30.785207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-67c30b81-0f40-4a1c-8f8f-ccbde6245e14 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:30.785621 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-67c30b81-0f40-4a1c-8f8f-ccbde6245e14 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:30.934046 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-67c30b81-0f40-4a1c-8f8f-ccbde6245e14 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:30.944540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-67c30b81-0f40-4a1c-8f8f-ccbde6245e14 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:30.946311 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-67c30b81-0f40-4a1c-8f8f-ccbde6245e14 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:30.947492 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-67c30b81-0f40-4a1c-8f8f-ccbde6245e14 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.176167 Sep 15 13:03:30.950783 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 225/443] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:30 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:31.973196 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c96cac4a-c347-44af-aef3-9780e248b982 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:31.973791 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c96cac4a-c347-44af-aef3-9780e248b982 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:31.979874 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c96cac4a-c347-44af-aef3-9780e248b982 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:31.980379 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c96cac4a-c347-44af-aef3-9780e248b982 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:31.980811 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c96cac4a-c347-44af-aef3-9780e248b982 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:31.981546 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c96cac4a-c347-44af-aef3-9780e248b982 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:31.981991 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c96cac4a-c347-44af-aef3-9780e248b982 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:31.982970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c96cac4a-c347-44af-aef3-9780e248b982 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:32.117025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c96cac4a-c347-44af-aef3-9780e248b982 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:32.126569 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c96cac4a-c347-44af-aef3-9780e248b982 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:32.128044 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c96cac4a-c347-44af-aef3-9780e248b982 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:32.129257 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c96cac4a-c347-44af-aef3-9780e248b982 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.159954 Sep 15 13:03:32.129819 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 219/444] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:31 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:33.153842 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-afd5dd48-e7b3-42e8-b671-7398409d044a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:33.155128 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-afd5dd48-e7b3-42e8-b671-7398409d044a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:33.161538 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-afd5dd48-e7b3-42e8-b671-7398409d044a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:33.162011 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-afd5dd48-e7b3-42e8-b671-7398409d044a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:33.162438 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-afd5dd48-e7b3-42e8-b671-7398409d044a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:33.163114 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-afd5dd48-e7b3-42e8-b671-7398409d044a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:33.163560 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-afd5dd48-e7b3-42e8-b671-7398409d044a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:33.163974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-afd5dd48-e7b3-42e8-b671-7398409d044a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:33.296240 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-afd5dd48-e7b3-42e8-b671-7398409d044a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:33.304841 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-afd5dd48-e7b3-42e8-b671-7398409d044a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:33.306291 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-afd5dd48-e7b3-42e8-b671-7398409d044a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:33.307437 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-afd5dd48-e7b3-42e8-b671-7398409d044a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.157457 Sep 15 13:03:33.307992 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 226/445] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:33 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:34.332823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-97531925-9976-4c86-b61d-aea6485e3b8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:34.333430 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-97531925-9976-4c86-b61d-aea6485e3b8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:34.339469 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97531925-9976-4c86-b61d-aea6485e3b8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:34.339950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97531925-9976-4c86-b61d-aea6485e3b8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:34.340410 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97531925-9976-4c86-b61d-aea6485e3b8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:34.341098 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97531925-9976-4c86-b61d-aea6485e3b8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:34.341635 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97531925-9976-4c86-b61d-aea6485e3b8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:34.342004 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97531925-9976-4c86-b61d-aea6485e3b8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:34.466895 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-97531925-9976-4c86-b61d-aea6485e3b8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:34.475322 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-97531925-9976-4c86-b61d-aea6485e3b8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:34.476785 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-97531925-9976-4c86-b61d-aea6485e3b8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:34.477930 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-97531925-9976-4c86-b61d-aea6485e3b8e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.149104 Sep 15 13:03:34.478488 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 220/446] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:34 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:34.942712 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b9969869-b3ea-499c-a058-681afb017041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6b1bc3d-8ba0-45c5-9292-912dcdaa1ef9"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:03:34.945045 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b9969869-b3ea-499c-a058-681afb017041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:34.952459 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b9969869-b3ea-499c-a058-681afb017041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:34.952943 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b9969869-b3ea-499c-a058-681afb017041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:34.953372 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b9969869-b3ea-499c-a058-681afb017041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:34.954059 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b9969869-b3ea-499c-a058-681afb017041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:34.954507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b9969869-b3ea-499c-a058-681afb017041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:34.954950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b9969869-b3ea-499c-a058-681afb017041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:35.504324 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c8fa4c56-5df9-464b-b901-3bab917d66f7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:35.504973 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c8fa4c56-5df9-464b-b901-3bab917d66f7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:35.510835 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8fa4c56-5df9-464b-b901-3bab917d66f7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:35.511313 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8fa4c56-5df9-464b-b901-3bab917d66f7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:35.511747 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8fa4c56-5df9-464b-b901-3bab917d66f7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:35.512470 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8fa4c56-5df9-464b-b901-3bab917d66f7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:35.512920 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8fa4c56-5df9-464b-b901-3bab917d66f7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:35.513341 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c8fa4c56-5df9-464b-b901-3bab917d66f7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:35.640778 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c8fa4c56-5df9-464b-b901-3bab917d66f7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:35.649490 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c8fa4c56-5df9-464b-b901-3bab917d66f7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:35.650940 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c8fa4c56-5df9-464b-b901-3bab917d66f7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:35.652090 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c8fa4c56-5df9-464b-b901-3bab917d66f7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.151839 Sep 15 13:03:35.652685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 221/447] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:35 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:03:36.259700 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b9969869-b3ea-499c-a058-681afb017041 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "POST /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.320720 Sep 15 13:03:36.260319 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 227/448] 10.222.0.57 () {60 vars in 1323 bytes} [Thu Sep 15 13:03:34 2022] POST /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-volume_attachments => generated 194 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:03:36.677230 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c273d599-6342-4157-a360-d7d34ddcb705 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:36.677819 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c273d599-6342-4157-a360-d7d34ddcb705 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:36.684054 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c273d599-6342-4157-a360-d7d34ddcb705 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:36.684517 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c273d599-6342-4157-a360-d7d34ddcb705 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:36.684953 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c273d599-6342-4157-a360-d7d34ddcb705 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:36.686369 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c273d599-6342-4157-a360-d7d34ddcb705 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:36.686821 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c273d599-6342-4157-a360-d7d34ddcb705 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:36.687243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c273d599-6342-4157-a360-d7d34ddcb705 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:36.820994 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c273d599-6342-4157-a360-d7d34ddcb705 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:36.829581 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c273d599-6342-4157-a360-d7d34ddcb705 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:36.831005 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c273d599-6342-4157-a360-d7d34ddcb705 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:36.832153 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c273d599-6342-4157-a360-d7d34ddcb705 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.158909 Sep 15 13:03:36.832742 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 222/449] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:36 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:37.858563 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-731fed20-be1d-4856-98b2-dbf3078ca457 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:37.859302 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-731fed20-be1d-4856-98b2-dbf3078ca457 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:37.865920 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-731fed20-be1d-4856-98b2-dbf3078ca457 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:37.866408 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-731fed20-be1d-4856-98b2-dbf3078ca457 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:37.866846 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-731fed20-be1d-4856-98b2-dbf3078ca457 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:37.867534 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-731fed20-be1d-4856-98b2-dbf3078ca457 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:37.867987 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-731fed20-be1d-4856-98b2-dbf3078ca457 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:37.868450 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-731fed20-be1d-4856-98b2-dbf3078ca457 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:37.999863 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-731fed20-be1d-4856-98b2-dbf3078ca457 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:38.008471 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-731fed20-be1d-4856-98b2-dbf3078ca457 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:38.009915 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-731fed20-be1d-4856-98b2-dbf3078ca457 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:38.011062 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-731fed20-be1d-4856-98b2-dbf3078ca457 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.157431 Sep 15 13:03:38.011621 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 228/450] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:37 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:39.038029 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e7fc56fe-0785-4e7b-8ce2-97ccb27e2956 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:39.038633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-e7fc56fe-0785-4e7b-8ce2-97ccb27e2956 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:39.045078 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e7fc56fe-0785-4e7b-8ce2-97ccb27e2956 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:39.045566 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e7fc56fe-0785-4e7b-8ce2-97ccb27e2956 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:39.045991 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e7fc56fe-0785-4e7b-8ce2-97ccb27e2956 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:39.046667 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e7fc56fe-0785-4e7b-8ce2-97ccb27e2956 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:39.047107 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e7fc56fe-0785-4e7b-8ce2-97ccb27e2956 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:39.047519 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e7fc56fe-0785-4e7b-8ce2-97ccb27e2956 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:39.175185 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e7fc56fe-0785-4e7b-8ce2-97ccb27e2956 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:39.183919 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e7fc56fe-0785-4e7b-8ce2-97ccb27e2956 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:39.185481 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e7fc56fe-0785-4e7b-8ce2-97ccb27e2956 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:39.186640 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e7fc56fe-0785-4e7b-8ce2-97ccb27e2956 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.152499 Sep 15 13:03:39.187201 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 223/451] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:39 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:40.212046 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7aeb620e-0be6-41ef-9f6f-b9f97a0155d6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:40.212672 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7aeb620e-0be6-41ef-9f6f-b9f97a0155d6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:40.219890 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7aeb620e-0be6-41ef-9f6f-b9f97a0155d6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:40.220430 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7aeb620e-0be6-41ef-9f6f-b9f97a0155d6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:40.220869 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7aeb620e-0be6-41ef-9f6f-b9f97a0155d6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:40.221562 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7aeb620e-0be6-41ef-9f6f-b9f97a0155d6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:40.222012 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7aeb620e-0be6-41ef-9f6f-b9f97a0155d6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:40.222439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7aeb620e-0be6-41ef-9f6f-b9f97a0155d6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:40.375735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7aeb620e-0be6-41ef-9f6f-b9f97a0155d6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:40.387921 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7aeb620e-0be6-41ef-9f6f-b9f97a0155d6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:40.390332 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7aeb620e-0be6-41ef-9f6f-b9f97a0155d6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:40.391627 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7aeb620e-0be6-41ef-9f6f-b9f97a0155d6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.183392 Sep 15 13:03:40.392655 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 229/452] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:40 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:41.418623 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b9090023-2f40-490e-93cb-691ac5b21568 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:41.419221 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b9090023-2f40-490e-93cb-691ac5b21568 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:41.426105 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b9090023-2f40-490e-93cb-691ac5b21568 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:41.426579 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b9090023-2f40-490e-93cb-691ac5b21568 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:41.427005 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b9090023-2f40-490e-93cb-691ac5b21568 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:41.427686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b9090023-2f40-490e-93cb-691ac5b21568 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:41.428126 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b9090023-2f40-490e-93cb-691ac5b21568 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:41.428562 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b9090023-2f40-490e-93cb-691ac5b21568 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:41.562217 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b9090023-2f40-490e-93cb-691ac5b21568 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:41.571078 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b9090023-2f40-490e-93cb-691ac5b21568 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:41.572550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b9090023-2f40-490e-93cb-691ac5b21568 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:41.573713 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b9090023-2f40-490e-93cb-691ac5b21568 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.159056 Sep 15 13:03:41.574269 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 224/453] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:41 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:42.599462 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0cca5b45-f97f-4b0a-af5a-8acafd7275b0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:42.600074 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0cca5b45-f97f-4b0a-af5a-8acafd7275b0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:42.606706 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0cca5b45-f97f-4b0a-af5a-8acafd7275b0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:42.607179 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0cca5b45-f97f-4b0a-af5a-8acafd7275b0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:42.607638 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0cca5b45-f97f-4b0a-af5a-8acafd7275b0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:42.608713 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0cca5b45-f97f-4b0a-af5a-8acafd7275b0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:42.609167 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0cca5b45-f97f-4b0a-af5a-8acafd7275b0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:42.609588 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0cca5b45-f97f-4b0a-af5a-8acafd7275b0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:42.739244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0cca5b45-f97f-4b0a-af5a-8acafd7275b0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:42.747746 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0cca5b45-f97f-4b0a-af5a-8acafd7275b0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:42.749385 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0cca5b45-f97f-4b0a-af5a-8acafd7275b0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:42.750538 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0cca5b45-f97f-4b0a-af5a-8acafd7275b0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.155008 Sep 15 13:03:42.751109 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 230/454] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:42 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:43.776715 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d717bd28-5b2f-423f-b2e6-646a0635406d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:43.777324 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d717bd28-5b2f-423f-b2e6-646a0635406d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:43.783750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d717bd28-5b2f-423f-b2e6-646a0635406d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:43.784229 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d717bd28-5b2f-423f-b2e6-646a0635406d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:43.784692 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d717bd28-5b2f-423f-b2e6-646a0635406d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:43.785372 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d717bd28-5b2f-423f-b2e6-646a0635406d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:43.785817 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d717bd28-5b2f-423f-b2e6-646a0635406d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:43.786238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d717bd28-5b2f-423f-b2e6-646a0635406d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:43.804148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:03:43.916265 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d717bd28-5b2f-423f-b2e6-646a0635406d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:43.925925 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d717bd28-5b2f-423f-b2e6-646a0635406d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:43.927515 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d717bd28-5b2f-423f-b2e6-646a0635406d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:43.928694 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d717bd28-5b2f-423f-b2e6-646a0635406d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.155826 Sep 15 13:03:43.929254 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 225/455] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:43 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:44.862240 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3a6c6df2-092e-46bc-a4a6-33b40368b749 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:03:44.864743 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3a6c6df2-092e-46bc-a4a6-33b40368b749 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:44.871124 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3a6c6df2-092e-46bc-a4a6-33b40368b749 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:44.871612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3a6c6df2-092e-46bc-a4a6-33b40368b749 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:44.872053 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3a6c6df2-092e-46bc-a4a6-33b40368b749 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:44.872778 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3a6c6df2-092e-46bc-a4a6-33b40368b749 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:44.873265 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3a6c6df2-092e-46bc-a4a6-33b40368b749 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:44.874325 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3a6c6df2-092e-46bc-a4a6-33b40368b749 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:44.897319 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-3a6c6df2-092e-46bc-a4a6-33b40368b749 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lazy-loading 'flavor' on Instance uuid f4ff8111-8ab2-4e8d-8278-f76f69b76196 {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:03:44.900965 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:03:44.953921 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-09a43c98-2d90-4437-b3fb-61e3131911c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:44.954577 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-09a43c98-2d90-4437-b3fb-61e3131911c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:44.961536 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-09a43c98-2d90-4437-b3fb-61e3131911c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:44.962264 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-09a43c98-2d90-4437-b3fb-61e3131911c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:44.962713 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-09a43c98-2d90-4437-b3fb-61e3131911c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:44.963413 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-09a43c98-2d90-4437-b3fb-61e3131911c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:44.963864 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-09a43c98-2d90-4437-b3fb-61e3131911c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:44.964311 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-09a43c98-2d90-4437-b3fb-61e3131911c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:45.034412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3a6c6df2-092e-46bc-a4a6-33b40368b749 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "POST /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/action" status: 200 len: 32 microversion: 2.1 time: 0.177009 Sep 15 13:03:45.036581 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 231/456] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Sep 15 13:03:44 2022] POST /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 13:03:45.046449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cc6424b9-0031-4064-98c6-57faab19689e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:45.047500 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cc6424b9-0031-4064-98c6-57faab19689e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:45.055344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc6424b9-0031-4064-98c6-57faab19689e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:45.055953 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc6424b9-0031-4064-98c6-57faab19689e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:45.056519 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc6424b9-0031-4064-98c6-57faab19689e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:45.057357 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc6424b9-0031-4064-98c6-57faab19689e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:45.057881 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc6424b9-0031-4064-98c6-57faab19689e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:45.058392 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc6424b9-0031-4064-98c6-57faab19689e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:45.108983 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-09a43c98-2d90-4437-b3fb-61e3131911c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:45.119326 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-09a43c98-2d90-4437-b3fb-61e3131911c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:45.121085 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-09a43c98-2d90-4437-b3fb-61e3131911c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:45.122484 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-09a43c98-2d90-4437-b3fb-61e3131911c0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.172710 Sep 15 13:03:45.123231 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 226/457] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:44 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:03:45.198238 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cc6424b9-0031-4064-98c6-57faab19689e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:45.207321 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cc6424b9-0031-4064-98c6-57faab19689e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.165619 Sep 15 13:03:45.207891 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 232/458] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:45 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:03:46.150694 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d74905d0-47c8-45b3-80b6-0fc4e05d56b8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:46.151302 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d74905d0-47c8-45b3-80b6-0fc4e05d56b8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:46.157792 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d74905d0-47c8-45b3-80b6-0fc4e05d56b8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:46.158271 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d74905d0-47c8-45b3-80b6-0fc4e05d56b8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:46.158705 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d74905d0-47c8-45b3-80b6-0fc4e05d56b8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:46.159386 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d74905d0-47c8-45b3-80b6-0fc4e05d56b8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:46.159831 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d74905d0-47c8-45b3-80b6-0fc4e05d56b8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:46.160250 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d74905d0-47c8-45b3-80b6-0fc4e05d56b8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:46.229749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bcf850b9-8b9e-447c-b1e8-18f020a00341 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:46.230396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-bcf850b9-8b9e-447c-b1e8-18f020a00341 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:46.236951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bcf850b9-8b9e-447c-b1e8-18f020a00341 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:46.237517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bcf850b9-8b9e-447c-b1e8-18f020a00341 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:46.237857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bcf850b9-8b9e-447c-b1e8-18f020a00341 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:46.238550 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bcf850b9-8b9e-447c-b1e8-18f020a00341 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:46.238999 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bcf850b9-8b9e-447c-b1e8-18f020a00341 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:46.239447 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bcf850b9-8b9e-447c-b1e8-18f020a00341 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:46.287796 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d74905d0-47c8-45b3-80b6-0fc4e05d56b8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:46.296686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d74905d0-47c8-45b3-80b6-0fc4e05d56b8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:46.298123 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d74905d0-47c8-45b3-80b6-0fc4e05d56b8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:46.299278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d74905d0-47c8-45b3-80b6-0fc4e05d56b8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.152539 Sep 15 13:03:46.299844 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 227/459] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:46 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:46.369982 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-bcf850b9-8b9e-447c-b1e8-18f020a00341 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:46.378405 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-bcf850b9-8b9e-447c-b1e8-18f020a00341 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.152577 Sep 15 13:03:46.378974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 233/460] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:46 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:03:46.921937 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-da2289de-96e9-4eb8-a3bb-7654670c91f6 req-27dac56c-2c63-4498-afab-8b45f3d92862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1777381a-01af-43ba-98dc-31bfeeded7bb", "name": "network-vif-plugged", "status": "completed", "tag": "12b0a8a8-4a84-4e3e-8e96-e6939fe11e18"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:03:46.931970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-da2289de-96e9-4eb8-a3bb-7654670c91f6 req-27dac56c-2c63-4498-afab-8b45f3d92862 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:46.932508 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-da2289de-96e9-4eb8-a3bb-7654670c91f6 req-27dac56c-2c63-4498-afab-8b45f3d92862 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:46.932917 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-da2289de-96e9-4eb8-a3bb-7654670c91f6 req-27dac56c-2c63-4498-afab-8b45f3d92862 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:46.944938 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-da2289de-96e9-4eb8-a3bb-7654670c91f6 req-27dac56c-2c63-4498-afab-8b45f3d92862 service nova] Creating event network-vif-plugged:12b0a8a8-4a84-4e3e-8e96-e6939fe11e18 for instance 1777381a-01af-43ba-98dc-31bfeeded7bb on hv-cinder-83608 Sep 15 13:03:46.949905 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-da2289de-96e9-4eb8-a3bb-7654670c91f6 req-27dac56c-2c63-4498-afab-8b45f3d92862 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031734 Sep 15 13:03:46.950514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 228/461] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:03:47.429397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-990322e4-6d7e-483b-8f54-9abfb5028808 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:47.430059 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-990322e4-6d7e-483b-8f54-9abfb5028808 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:47.437228 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-990322e4-6d7e-483b-8f54-9abfb5028808 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:47.437727 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-990322e4-6d7e-483b-8f54-9abfb5028808 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:47.438324 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-990322e4-6d7e-483b-8f54-9abfb5028808 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:47.439031 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-990322e4-6d7e-483b-8f54-9abfb5028808 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:47.439548 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-990322e4-6d7e-483b-8f54-9abfb5028808 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:47.439974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-990322e4-6d7e-483b-8f54-9abfb5028808 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:47.509549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-aac0e973-c358-4b34-a058-8ed2b963a082 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:47.510240 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-aac0e973-c358-4b34-a058-8ed2b963a082 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:47.518427 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-aac0e973-c358-4b34-a058-8ed2b963a082 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:47.519214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-aac0e973-c358-4b34-a058-8ed2b963a082 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:47.519838 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-aac0e973-c358-4b34-a058-8ed2b963a082 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:47.520749 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-aac0e973-c358-4b34-a058-8ed2b963a082 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:47.521191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-aac0e973-c358-4b34-a058-8ed2b963a082 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:47.521609 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-aac0e973-c358-4b34-a058-8ed2b963a082 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:47.583553 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-990322e4-6d7e-483b-8f54-9abfb5028808 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:47.592294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-990322e4-6d7e-483b-8f54-9abfb5028808 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:47.594550 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-990322e4-6d7e-483b-8f54-9abfb5028808 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:47.595794 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-990322e4-6d7e-483b-8f54-9abfb5028808 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.275033 Sep 15 13:03:47.596378 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 234/462] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:47 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:47.709961 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-aac0e973-c358-4b34-a058-8ed2b963a082 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:47.718431 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-aac0e973-c358-4b34-a058-8ed2b963a082 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.320481 Sep 15 13:03:47.718994 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 229/463] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:47 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:48.621414 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c02e0ac4-53f1-497a-a84c-03aca6fa894f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:48.622021 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c02e0ac4-53f1-497a-a84c-03aca6fa894f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:48.628617 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c02e0ac4-53f1-497a-a84c-03aca6fa894f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:48.629099 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c02e0ac4-53f1-497a-a84c-03aca6fa894f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:48.629530 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c02e0ac4-53f1-497a-a84c-03aca6fa894f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:48.630214 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c02e0ac4-53f1-497a-a84c-03aca6fa894f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:48.630661 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c02e0ac4-53f1-497a-a84c-03aca6fa894f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:48.631083 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c02e0ac4-53f1-497a-a84c-03aca6fa894f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:48.742293 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-9af2a99a-3b6f-4cb5-8d95-32be76e1565e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:48.742906 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-9af2a99a-3b6f-4cb5-8d95-32be76e1565e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:48.749181 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9af2a99a-3b6f-4cb5-8d95-32be76e1565e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:48.749771 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9af2a99a-3b6f-4cb5-8d95-32be76e1565e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:48.750213 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9af2a99a-3b6f-4cb5-8d95-32be76e1565e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:48.750912 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9af2a99a-3b6f-4cb5-8d95-32be76e1565e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:48.751367 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9af2a99a-3b6f-4cb5-8d95-32be76e1565e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:48.751792 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9af2a99a-3b6f-4cb5-8d95-32be76e1565e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:48.761890 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c02e0ac4-53f1-497a-a84c-03aca6fa894f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:48.771317 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c02e0ac4-53f1-497a-a84c-03aca6fa894f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:48.772773 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c02e0ac4-53f1-497a-a84c-03aca6fa894f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:48.773930 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c02e0ac4-53f1-497a-a84c-03aca6fa894f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.156413 Sep 15 13:03:48.774485 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 235/464] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:48 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:48.882898 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9af2a99a-3b6f-4cb5-8d95-32be76e1565e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:48.891675 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-9af2a99a-3b6f-4cb5-8d95-32be76e1565e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.153273 Sep 15 13:03:48.892241 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 230/465] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:48 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:03:49.799364 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-55938aab-b464-45d9-a62a-982cd27fee5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:49.800004 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-55938aab-b464-45d9-a62a-982cd27fee5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:49.806450 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55938aab-b464-45d9-a62a-982cd27fee5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:49.806939 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55938aab-b464-45d9-a62a-982cd27fee5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:49.807373 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55938aab-b464-45d9-a62a-982cd27fee5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:49.808066 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55938aab-b464-45d9-a62a-982cd27fee5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:49.808612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55938aab-b464-45d9-a62a-982cd27fee5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:49.809037 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-55938aab-b464-45d9-a62a-982cd27fee5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:49.915485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-bd3ad667-b60f-404d-a4e1-3a1922d49711 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:49.916945 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-bd3ad667-b60f-404d-a4e1-3a1922d49711 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:49.924292 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bd3ad667-b60f-404d-a4e1-3a1922d49711 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:49.924778 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bd3ad667-b60f-404d-a4e1-3a1922d49711 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:49.925213 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bd3ad667-b60f-404d-a4e1-3a1922d49711 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:49.926128 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bd3ad667-b60f-404d-a4e1-3a1922d49711 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:49.926914 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bd3ad667-b60f-404d-a4e1-3a1922d49711 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:49.927705 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bd3ad667-b60f-404d-a4e1-3a1922d49711 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:49.945855 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-55938aab-b464-45d9-a62a-982cd27fee5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:49.955037 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-55938aab-b464-45d9-a62a-982cd27fee5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:49.956501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-55938aab-b464-45d9-a62a-982cd27fee5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:49.957656 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-55938aab-b464-45d9-a62a-982cd27fee5e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1809 microversion: 2.20 time: 0.162707 Sep 15 13:03:49.958209 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 236/466] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:49 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:03:50.059778 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-bd3ad667-b60f-404d-a4e1-3a1922d49711 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:50.068587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-bd3ad667-b60f-404d-a4e1-3a1922d49711 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.157299 Sep 15 13:03:50.069193 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 231/467] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:49 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:50.984621 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ee026501-0fc4-434b-9cf3-0c7fc9b7c63f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:50.985892 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ee026501-0fc4-434b-9cf3-0c7fc9b7c63f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:50.992504 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ee026501-0fc4-434b-9cf3-0c7fc9b7c63f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:50.992992 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ee026501-0fc4-434b-9cf3-0c7fc9b7c63f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:50.993429 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ee026501-0fc4-434b-9cf3-0c7fc9b7c63f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:50.994185 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ee026501-0fc4-434b-9cf3-0c7fc9b7c63f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:50.994637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ee026501-0fc4-434b-9cf3-0c7fc9b7c63f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:50.995057 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ee026501-0fc4-434b-9cf3-0c7fc9b7c63f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:51.092119 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-72740cc6-121c-4cda-aa31-02daf50ed165 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:51.093438 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-72740cc6-121c-4cda-aa31-02daf50ed165 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:51.099583 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72740cc6-121c-4cda-aa31-02daf50ed165 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:51.100082 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72740cc6-121c-4cda-aa31-02daf50ed165 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:51.100484 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72740cc6-121c-4cda-aa31-02daf50ed165 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:51.101180 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72740cc6-121c-4cda-aa31-02daf50ed165 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:51.101628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72740cc6-121c-4cda-aa31-02daf50ed165 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:51.102048 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72740cc6-121c-4cda-aa31-02daf50ed165 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:51.129362 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ee026501-0fc4-434b-9cf3-0c7fc9b7c63f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:51.138033 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ee026501-0fc4-434b-9cf3-0c7fc9b7c63f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:51.139547 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ee026501-0fc4-434b-9cf3-0c7fc9b7c63f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:51.140926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ee026501-0fc4-434b-9cf3-0c7fc9b7c63f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1796 microversion: 2.20 time: 0.160978 Sep 15 13:03:51.141486 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 237/468] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:03:50 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1796 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:03:51.229885 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-72740cc6-121c-4cda-aa31-02daf50ed165 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:51.240487 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-72740cc6-121c-4cda-aa31-02daf50ed165 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.152148 Sep 15 13:03:51.241050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 232/469] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:51 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:03:52.263618 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-457b8e30-4c4e-4d81-bb24-fc353c2544e2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:52.264202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-457b8e30-4c4e-4d81-bb24-fc353c2544e2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:52.270881 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-457b8e30-4c4e-4d81-bb24-fc353c2544e2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:52.271354 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-457b8e30-4c4e-4d81-bb24-fc353c2544e2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:52.271780 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-457b8e30-4c4e-4d81-bb24-fc353c2544e2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:52.272495 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-457b8e30-4c4e-4d81-bb24-fc353c2544e2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:52.272946 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-457b8e30-4c4e-4d81-bb24-fc353c2544e2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:52.273363 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-457b8e30-4c4e-4d81-bb24-fc353c2544e2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:52.401843 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-457b8e30-4c4e-4d81-bb24-fc353c2544e2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:52.410051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-457b8e30-4c4e-4d81-bb24-fc353c2544e2 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.150334 Sep 15 13:03:52.410613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 238/470] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:52 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:53.433490 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-abf0fc81-fa3b-4e65-9fa3-b42d4751cd0f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:53.434103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-abf0fc81-fa3b-4e65-9fa3-b42d4751cd0f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:53.440097 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abf0fc81-fa3b-4e65-9fa3-b42d4751cd0f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:53.440607 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abf0fc81-fa3b-4e65-9fa3-b42d4751cd0f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:53.441040 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abf0fc81-fa3b-4e65-9fa3-b42d4751cd0f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:53.441721 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abf0fc81-fa3b-4e65-9fa3-b42d4751cd0f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:53.442168 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abf0fc81-fa3b-4e65-9fa3-b42d4751cd0f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:53.442586 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abf0fc81-fa3b-4e65-9fa3-b42d4751cd0f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:53.818034 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-abf0fc81-fa3b-4e65-9fa3-b42d4751cd0f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:53.826645 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-abf0fc81-fa3b-4e65-9fa3-b42d4751cd0f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.397010 Sep 15 13:03:53.827738 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 233/471] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:53 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:54.850810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9f6f09ac-b1bd-499f-b81e-811be0705b12 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:54.851430 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9f6f09ac-b1bd-499f-b81e-811be0705b12 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:54.858692 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9f6f09ac-b1bd-499f-b81e-811be0705b12 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:54.859182 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9f6f09ac-b1bd-499f-b81e-811be0705b12 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:54.859616 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9f6f09ac-b1bd-499f-b81e-811be0705b12 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:54.860359 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9f6f09ac-b1bd-499f-b81e-811be0705b12 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:54.860813 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9f6f09ac-b1bd-499f-b81e-811be0705b12 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:54.861235 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9f6f09ac-b1bd-499f-b81e-811be0705b12 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:54.991508 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9f6f09ac-b1bd-499f-b81e-811be0705b12 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:54.999931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9f6f09ac-b1bd-499f-b81e-811be0705b12 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.152974 Sep 15 13:03:55.000550 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 239/472] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:54 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:56.023445 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6b9c15db-cd6e-45a9-ad5b-2887280720f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:56.024085 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6b9c15db-cd6e-45a9-ad5b-2887280720f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:56.030830 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b9c15db-cd6e-45a9-ad5b-2887280720f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:56.031311 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b9c15db-cd6e-45a9-ad5b-2887280720f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:56.031751 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b9c15db-cd6e-45a9-ad5b-2887280720f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:56.032469 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b9c15db-cd6e-45a9-ad5b-2887280720f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:56.032917 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b9c15db-cd6e-45a9-ad5b-2887280720f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:56.033339 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b9c15db-cd6e-45a9-ad5b-2887280720f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:56.162182 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6b9c15db-cd6e-45a9-ad5b-2887280720f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:56.170900 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6b9c15db-cd6e-45a9-ad5b-2887280720f7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.151331 Sep 15 13:03:56.171477 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 234/473] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:56 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:57.194822 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cd626663-28f2-4294-99b6-4e445ea25599 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:57.195432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cd626663-28f2-4294-99b6-4e445ea25599 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:57.202949 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd626663-28f2-4294-99b6-4e445ea25599 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:57.203436 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd626663-28f2-4294-99b6-4e445ea25599 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:57.203864 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd626663-28f2-4294-99b6-4e445ea25599 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:57.204574 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd626663-28f2-4294-99b6-4e445ea25599 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:57.205024 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd626663-28f2-4294-99b6-4e445ea25599 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:57.205439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cd626663-28f2-4294-99b6-4e445ea25599 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:57.532844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cd626663-28f2-4294-99b6-4e445ea25599 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:57.540882 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cd626663-28f2-4294-99b6-4e445ea25599 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.349961 Sep 15 13:03:57.541438 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 240/474] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:57 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:58.564514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f93c4f7e-c43a-474d-b614-b1e9a713a415 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:58.565144 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f93c4f7e-c43a-474d-b614-b1e9a713a415 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:58.571129 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f93c4f7e-c43a-474d-b614-b1e9a713a415 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:58.571558 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f93c4f7e-c43a-474d-b614-b1e9a713a415 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:58.571988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f93c4f7e-c43a-474d-b614-b1e9a713a415 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:58.572726 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f93c4f7e-c43a-474d-b614-b1e9a713a415 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:58.573173 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f93c4f7e-c43a-474d-b614-b1e9a713a415 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:58.573590 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f93c4f7e-c43a-474d-b614-b1e9a713a415 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:58.703366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f93c4f7e-c43a-474d-b614-b1e9a713a415 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:58.711587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f93c4f7e-c43a-474d-b614-b1e9a713a415 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.151048 Sep 15 13:03:58.712148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 235/475] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:58 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:03:59.734853 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2dd4556a-1689-47a3-8800-4fa5ac1f4d36 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:03:59.735462 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2dd4556a-1689-47a3-8800-4fa5ac1f4d36 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:03:59.737923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=34 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:03:59.743029 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2dd4556a-1689-47a3-8800-4fa5ac1f4d36 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:59.743514 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2dd4556a-1689-47a3-8800-4fa5ac1f4d36 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:59.743949 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2dd4556a-1689-47a3-8800-4fa5ac1f4d36 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:59.744665 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2dd4556a-1689-47a3-8800-4fa5ac1f4d36 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:03:59.745122 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2dd4556a-1689-47a3-8800-4fa5ac1f4d36 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:03:59.745546 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2dd4556a-1689-47a3-8800-4fa5ac1f4d36 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:03:59.871973 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2dd4556a-1689-47a3-8800-4fa5ac1f4d36 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:03:59.880504 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2dd4556a-1689-47a3-8800-4fa5ac1f4d36 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.149493 Sep 15 13:03:59.881072 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 241/476] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:03:59 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:00.904593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a1a40eab-1def-409e-8add-058be7281f64 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:00.906102 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a1a40eab-1def-409e-8add-058be7281f64 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:00.908208 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=36 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:00.914581 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a1a40eab-1def-409e-8add-058be7281f64 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:00.915061 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a1a40eab-1def-409e-8add-058be7281f64 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:00.915492 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a1a40eab-1def-409e-8add-058be7281f64 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:00.916472 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a1a40eab-1def-409e-8add-058be7281f64 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:00.916923 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a1a40eab-1def-409e-8add-058be7281f64 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:00.917342 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a1a40eab-1def-409e-8add-058be7281f64 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:01.042559 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a1a40eab-1def-409e-8add-058be7281f64 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:01.051426 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a1a40eab-1def-409e-8add-058be7281f64 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.151111 Sep 15 13:04:01.051990 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 236/477] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:00 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:02.074483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-fe7ef291-d046-49b8-956f-82ce699e681e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:02.075078 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-fe7ef291-d046-49b8-956f-82ce699e681e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:02.082606 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe7ef291-d046-49b8-956f-82ce699e681e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:02.083095 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe7ef291-d046-49b8-956f-82ce699e681e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:02.083527 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe7ef291-d046-49b8-956f-82ce699e681e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:02.088178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe7ef291-d046-49b8-956f-82ce699e681e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:02.088178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe7ef291-d046-49b8-956f-82ce699e681e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:02.088178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe7ef291-d046-49b8-956f-82ce699e681e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:02.215545 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-fe7ef291-d046-49b8-956f-82ce699e681e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:02.224512 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-fe7ef291-d046-49b8-956f-82ce699e681e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.153803 Sep 15 13:04:02.225068 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 242/478] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:02 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:03.247935 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-50151a8a-c08d-44b5-acf1-d7860e85e330 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:03.248570 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-50151a8a-c08d-44b5-acf1-d7860e85e330 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:03.254990 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-50151a8a-c08d-44b5-acf1-d7860e85e330 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:03.255473 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-50151a8a-c08d-44b5-acf1-d7860e85e330 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:03.255908 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-50151a8a-c08d-44b5-acf1-d7860e85e330 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:03.256621 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-50151a8a-c08d-44b5-acf1-d7860e85e330 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:03.257072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-50151a8a-c08d-44b5-acf1-d7860e85e330 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:03.257492 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-50151a8a-c08d-44b5-acf1-d7860e85e330 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:03.386133 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-50151a8a-c08d-44b5-acf1-d7860e85e330 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:03.395155 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-50151a8a-c08d-44b5-acf1-d7860e85e330 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.151145 Sep 15 13:04:03.395714 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 237/479] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:03 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:04.418770 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ffcdb5f4-6cf8-4bf0-8cc0-f541c6701340 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:04.419324 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ffcdb5f4-6cf8-4bf0-8cc0-f541c6701340 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:04.425771 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ffcdb5f4-6cf8-4bf0-8cc0-f541c6701340 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:04.426255 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ffcdb5f4-6cf8-4bf0-8cc0-f541c6701340 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:04.426689 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ffcdb5f4-6cf8-4bf0-8cc0-f541c6701340 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:04.427382 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ffcdb5f4-6cf8-4bf0-8cc0-f541c6701340 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:04.427833 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ffcdb5f4-6cf8-4bf0-8cc0-f541c6701340 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:04.428255 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ffcdb5f4-6cf8-4bf0-8cc0-f541c6701340 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:04.553477 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ffcdb5f4-6cf8-4bf0-8cc0-f541c6701340 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:04.561634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ffcdb5f4-6cf8-4bf0-8cc0-f541c6701340 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.146778 Sep 15 13:04:04.562201 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 243/480] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:04 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:05.585550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-079b40cb-fa4f-4720-93fd-3b14a74ebdb7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:05.586179 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-079b40cb-fa4f-4720-93fd-3b14a74ebdb7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:05.592057 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-079b40cb-fa4f-4720-93fd-3b14a74ebdb7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:05.592586 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-079b40cb-fa4f-4720-93fd-3b14a74ebdb7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:05.593025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-079b40cb-fa4f-4720-93fd-3b14a74ebdb7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:05.594009 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-079b40cb-fa4f-4720-93fd-3b14a74ebdb7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:05.594516 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-079b40cb-fa4f-4720-93fd-3b14a74ebdb7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:05.594947 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-079b40cb-fa4f-4720-93fd-3b14a74ebdb7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:05.723144 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-079b40cb-fa4f-4720-93fd-3b14a74ebdb7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:05.731282 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-079b40cb-fa4f-4720-93fd-3b14a74ebdb7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.149621 Sep 15 13:04:05.731843 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 238/481] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:05 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:06.755390 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c82c5ac5-99bd-44ae-bfbb-4d3d48ac99dd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:06.756001 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c82c5ac5-99bd-44ae-bfbb-4d3d48ac99dd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:06.762725 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c82c5ac5-99bd-44ae-bfbb-4d3d48ac99dd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:06.763208 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c82c5ac5-99bd-44ae-bfbb-4d3d48ac99dd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:06.763638 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c82c5ac5-99bd-44ae-bfbb-4d3d48ac99dd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:06.764353 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c82c5ac5-99bd-44ae-bfbb-4d3d48ac99dd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:06.764809 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c82c5ac5-99bd-44ae-bfbb-4d3d48ac99dd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:06.765224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c82c5ac5-99bd-44ae-bfbb-4d3d48ac99dd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:06.897813 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c82c5ac5-99bd-44ae-bfbb-4d3d48ac99dd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:06.906042 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c82c5ac5-99bd-44ae-bfbb-4d3d48ac99dd tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.154503 Sep 15 13:04:06.907161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 244/482] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:06 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:07.930918 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-7d222e5d-0cd4-412c-a1ec-ca4ee6a1ec29 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:07.931529 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-7d222e5d-0cd4-412c-a1ec-ca4ee6a1ec29 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:07.938940 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7d222e5d-0cd4-412c-a1ec-ca4ee6a1ec29 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:07.939416 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7d222e5d-0cd4-412c-a1ec-ca4ee6a1ec29 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:07.939851 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7d222e5d-0cd4-412c-a1ec-ca4ee6a1ec29 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:07.940567 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7d222e5d-0cd4-412c-a1ec-ca4ee6a1ec29 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:07.941019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7d222e5d-0cd4-412c-a1ec-ca4ee6a1ec29 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:07.941439 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7d222e5d-0cd4-412c-a1ec-ca4ee6a1ec29 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:08.068332 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-7d222e5d-0cd4-412c-a1ec-ca4ee6a1ec29 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:08.076449 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-7d222e5d-0cd4-412c-a1ec-ca4ee6a1ec29 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.149401 Sep 15 13:04:08.077014 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 239/483] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:07 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:09.099441 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-02e66e87-38bd-45f9-8ca8-9da77afe2178 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:09.100058 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-02e66e87-38bd-45f9-8ca8-9da77afe2178 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:09.106552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-02e66e87-38bd-45f9-8ca8-9da77afe2178 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:09.107035 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-02e66e87-38bd-45f9-8ca8-9da77afe2178 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:09.107472 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-02e66e87-38bd-45f9-8ca8-9da77afe2178 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:09.108162 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-02e66e87-38bd-45f9-8ca8-9da77afe2178 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:09.108641 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-02e66e87-38bd-45f9-8ca8-9da77afe2178 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:09.109062 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-02e66e87-38bd-45f9-8ca8-9da77afe2178 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:09.235558 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-02e66e87-38bd-45f9-8ca8-9da77afe2178 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:09.243693 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-02e66e87-38bd-45f9-8ca8-9da77afe2178 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1735 microversion: 2.1 time: 0.148133 Sep 15 13:04:09.244251 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 245/484] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:09 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:10.267013 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-58f22737-8548-4430-8989-1608d8925189 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:10.267616 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-58f22737-8548-4430-8989-1608d8925189 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:10.273765 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-58f22737-8548-4430-8989-1608d8925189 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:10.274242 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-58f22737-8548-4430-8989-1608d8925189 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:10.274669 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-58f22737-8548-4430-8989-1608d8925189 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:10.275347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-58f22737-8548-4430-8989-1608d8925189 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:10.275798 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-58f22737-8548-4430-8989-1608d8925189 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:10.276214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-58f22737-8548-4430-8989-1608d8925189 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:10.402780 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-58f22737-8548-4430-8989-1608d8925189 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:10.411544 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-58f22737-8548-4430-8989-1608d8925189 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1715 microversion: 2.1 time: 0.148990 Sep 15 13:04:10.412103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 240/485] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:10 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1715 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:10.472722 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bcde9071-46eb-4b18-9b4f-c143bbe50fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:10.473202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-bcde9071-46eb-4b18-9b4f-c143bbe50fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:10.479453 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bcde9071-46eb-4b18-9b4f-c143bbe50fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:10.479924 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bcde9071-46eb-4b18-9b4f-c143bbe50fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:10.480461 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bcde9071-46eb-4b18-9b4f-c143bbe50fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:10.481143 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bcde9071-46eb-4b18-9b4f-c143bbe50fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:10.481589 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bcde9071-46eb-4b18-9b4f-c143bbe50fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:10.482004 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bcde9071-46eb-4b18-9b4f-c143bbe50fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:10.542625 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:10.611288 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-bcde9071-46eb-4b18-9b4f-c143bbe50fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] HTTP exception thrown: Cannot 'detach_volume' instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 while it is in vm_state rescued Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bcde9071-46eb-4b18-9b4f-c143bbe50fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Request method failure captured: Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: DELETE /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-volume_attachments/f6b1bc3d-8ba0-45c5-9292-912dcdaa1ef9 HTTP/1.1 Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyGGCvLr9NLDVLXNqodZA-HvHUau1u28TZ4av1Me93TUra2_ZrMm-nemJSD3Xgpnw_hfXFGIiBR73bkafisfR4v_bKp_0MCgPx-6n1Prv4poDN8_ciPTltTdBEeB323EV2ZAFZg2deCAbtg5TiCZqhByQgp7jHFDyyOpCDrtl1VhhtQ Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: ffff4b9feef3437cb5529aeaaacc3f86 Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:04:10.612845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:04:10.614297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ffff4b9feef3437cb5529aeaaacc3f86", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ffff4b9feef3437cb5529aeaaacc3f86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ffff4b9feef3437cb5529aeaaacc3f86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ffff4b9feef3437cb5529aeaaacc3f86"}]}] Sep 15 13:04:10.614297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:04:10.614297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: ffff4b9feef3437cb5529aeaaacc3f86 Sep 15 13:04:10.614297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:04:10.614297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-ServerRescueNegativeTestJSON-1079457351-project Sep 15 13:04:10.614297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:04:10.614297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:04:10.614297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: e2ef1277bf944722aa33077985fb4734 Sep 15 13:04:10.614297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1079457351-project Sep 15 13:04:10.614297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:04:10.614297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Cannot 'detach_volume' instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 while it is in vm_state rescued Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'server_id': 'f4ff8111-8ab2-4e8d-8278-f76f69b76196', 'id': 'f6b1bc3d-8ba0-45c5-9292-912dcdaa1ef9'} Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:04:10.614997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 while it is in vm_state rescued Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 while it is in vm_state rescued Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:10.616286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bcde9071-46eb-4b18-9b4f-c143bbe50fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Returning 409 to user: Cannot 'detach_volume' instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 while it is in vm_state rescued {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:04:10.617305 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-bcde9071-46eb-4b18-9b4f-c143bbe50fcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-volume_attachments/f6b1bc3d-8ba0-45c5-9292-912dcdaa1ef9" status: 409 len: 152 microversion: 2.1 time: 0.145900 Sep 15 13:04:10.617305 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 246/486] 10.222.0.57 () {58 vars in 1416 bytes} [Thu Sep 15 13:04:10 2022] DELETE /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-volume_attachments/f6b1bc3d-8ba0-45c5-9292-912dcdaa1ef9 => generated 152 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 15 13:04:10.623237 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6d5230bd-6715-4693-ac00-a8e557e81dcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:04:10.623761 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6d5230bd-6715-4693-ac00-a8e557e81dcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:10.629589 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d5230bd-6715-4693-ac00-a8e557e81dcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:10.630123 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d5230bd-6715-4693-ac00-a8e557e81dcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:10.630551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d5230bd-6715-4693-ac00-a8e557e81dcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:10.631228 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d5230bd-6715-4693-ac00-a8e557e81dcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:10.631784 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d5230bd-6715-4693-ac00-a8e557e81dcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:10.632203 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d5230bd-6715-4693-ac00-a8e557e81dcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:10.699529 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:10.710174 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6d5230bd-6715-4693-ac00-a8e557e81dcb tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "POST /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/action" status: 202 len: 0 microversion: 2.1 time: 0.090656 Sep 15 13:04:10.710961 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 241/487] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Sep 15 13:04:10 2022] POST /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:04:10.719766 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-976cb88f-e52f-453c-922c-9ac6b6c05c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:10.720830 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-976cb88f-e52f-453c-922c-9ac6b6c05c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:10.729103 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-976cb88f-e52f-453c-922c-9ac6b6c05c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:10.730086 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-976cb88f-e52f-453c-922c-9ac6b6c05c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:10.730744 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-976cb88f-e52f-453c-922c-9ac6b6c05c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:10.731474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-976cb88f-e52f-453c-922c-9ac6b6c05c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:10.731918 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-976cb88f-e52f-453c-922c-9ac6b6c05c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:10.732371 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-976cb88f-e52f-453c-922c-9ac6b6c05c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:10.865150 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-976cb88f-e52f-453c-922c-9ac6b6c05c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:10.873227 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-976cb88f-e52f-453c-922c-9ac6b6c05c34 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1723 microversion: 2.1 time: 0.158098 Sep 15 13:04:10.873785 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 247/488] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:10 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:04:11.898065 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fdca35b3-38e3-4738-888c-dab07b0f6ec8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:11.898674 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-fdca35b3-38e3-4738-888c-dab07b0f6ec8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:11.905799 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fdca35b3-38e3-4738-888c-dab07b0f6ec8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:11.906875 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fdca35b3-38e3-4738-888c-dab07b0f6ec8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:11.907318 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fdca35b3-38e3-4738-888c-dab07b0f6ec8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:11.908000 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fdca35b3-38e3-4738-888c-dab07b0f6ec8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:11.908470 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fdca35b3-38e3-4738-888c-dab07b0f6ec8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:11.908884 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fdca35b3-38e3-4738-888c-dab07b0f6ec8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:12.041440 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-fdca35b3-38e3-4738-888c-dab07b0f6ec8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:12.049707 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-fdca35b3-38e3-4738-888c-dab07b0f6ec8 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1723 microversion: 2.1 time: 0.156474 Sep 15 13:04:12.050272 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 242/489] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:11 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:13.073488 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-20cabee5-5d6a-487a-83b4-8c22d7813c21 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:13.074092 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-20cabee5-5d6a-487a-83b4-8c22d7813c21 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:13.081555 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-20cabee5-5d6a-487a-83b4-8c22d7813c21 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:13.082035 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-20cabee5-5d6a-487a-83b4-8c22d7813c21 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:13.082465 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-20cabee5-5d6a-487a-83b4-8c22d7813c21 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:13.083173 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-20cabee5-5d6a-487a-83b4-8c22d7813c21 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:13.083605 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-20cabee5-5d6a-487a-83b4-8c22d7813c21 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:13.084017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-20cabee5-5d6a-487a-83b4-8c22d7813c21 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:13.213725 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-20cabee5-5d6a-487a-83b4-8c22d7813c21 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:13.222024 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-20cabee5-5d6a-487a-83b4-8c22d7813c21 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1723 microversion: 2.1 time: 0.152436 Sep 15 13:04:13.222587 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 248/490] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:13 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:14.245920 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-58734eee-eac6-416e-a374-ee885784a821 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:14.246530 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-58734eee-eac6-416e-a374-ee885784a821 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:14.253564 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-58734eee-eac6-416e-a374-ee885784a821 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:14.254037 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-58734eee-eac6-416e-a374-ee885784a821 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:14.254465 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-58734eee-eac6-416e-a374-ee885784a821 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:14.255138 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-58734eee-eac6-416e-a374-ee885784a821 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:14.255582 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-58734eee-eac6-416e-a374-ee885784a821 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:14.255996 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-58734eee-eac6-416e-a374-ee885784a821 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:14.383624 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-58734eee-eac6-416e-a374-ee885784a821 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:14.392088 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-58734eee-eac6-416e-a374-ee885784a821 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1723 microversion: 2.1 time: 0.150058 Sep 15 13:04:14.392688 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 243/491] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:14 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:15.416009 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-374f5622-226f-4c16-bb0f-510e5321fdd0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:15.416565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-374f5622-226f-4c16-bb0f-510e5321fdd0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:15.423448 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-374f5622-226f-4c16-bb0f-510e5321fdd0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:15.423926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-374f5622-226f-4c16-bb0f-510e5321fdd0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:15.424392 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-374f5622-226f-4c16-bb0f-510e5321fdd0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:15.425076 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-374f5622-226f-4c16-bb0f-510e5321fdd0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:15.425527 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-374f5622-226f-4c16-bb0f-510e5321fdd0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:15.425945 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-374f5622-226f-4c16-bb0f-510e5321fdd0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:15.553438 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-374f5622-226f-4c16-bb0f-510e5321fdd0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:15.561630 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-374f5622-226f-4c16-bb0f-510e5321fdd0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1729 microversion: 2.1 time: 0.149616 Sep 15 13:04:15.562196 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 249/492] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:15 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:15.584738 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-59e9ce5a-9a3b-48c9-8d9f-7337c8905d5f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:15.585261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-59e9ce5a-9a3b-48c9-8d9f-7337c8905d5f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:15.591081 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-59e9ce5a-9a3b-48c9-8d9f-7337c8905d5f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:15.591571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-59e9ce5a-9a3b-48c9-8d9f-7337c8905d5f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:15.592003 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-59e9ce5a-9a3b-48c9-8d9f-7337c8905d5f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:15.592720 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-59e9ce5a-9a3b-48c9-8d9f-7337c8905d5f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:15.593172 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-59e9ce5a-9a3b-48c9-8d9f-7337c8905d5f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:15.593591 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-59e9ce5a-9a3b-48c9-8d9f-7337c8905d5f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:15.669252 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-59e9ce5a-9a3b-48c9-8d9f-7337c8905d5f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088355 Sep 15 13:04:15.669844 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 244/493] 10.222.0.57 () {58 vars in 1275 bytes} [Thu Sep 15 13:04:15 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:04:15.898149 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-79e53400-7b7e-4c55-b3ed-5d84f2202491 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:15.898894 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-79e53400-7b7e-4c55-b3ed-5d84f2202491 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:15.904959 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-79e53400-7b7e-4c55-b3ed-5d84f2202491 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:15.905535 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-79e53400-7b7e-4c55-b3ed-5d84f2202491 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:15.906035 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-79e53400-7b7e-4c55-b3ed-5d84f2202491 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:15.907355 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-79e53400-7b7e-4c55-b3ed-5d84f2202491 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:15.907883 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-79e53400-7b7e-4c55-b3ed-5d84f2202491 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:15.908415 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-79e53400-7b7e-4c55-b3ed-5d84f2202491 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:15.991736 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-79e53400-7b7e-4c55-b3ed-5d84f2202491 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lazy-loading 'services' on Instance uuid 2c7538af-56ab-4022-85eb-172a1ee55d71 {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:04:16.117783 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-79e53400-7b7e-4c55-b3ed-5d84f2202491 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/os-volume_attachments/3025f169-aa09-46af-8598-fe9bae59d402" status: 202 len: 0 microversion: 2.1 time: 0.326437 Sep 15 13:04:16.118644 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 250/494] 10.222.0.57 () {58 vars in 1416 bytes} [Thu Sep 15 13:04:15 2022] DELETE /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/os-volume_attachments/3025f169-aa09-46af-8598-fe9bae59d402 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:04:16.617835 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-334e6669-a194-4ddb-89de-3add54f3a1bf req-157da363-2ae7-41e1-8b95-7a03a9b3f642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4ff8111-8ab2-4e8d-8278-f76f69b76196", "tag": "de279c4f-9053-44d1-aa49-aa402574c2ed"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:04:16.627666 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-334e6669-a194-4ddb-89de-3add54f3a1bf req-157da363-2ae7-41e1-8b95-7a03a9b3f642 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:16.628236 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-334e6669-a194-4ddb-89de-3add54f3a1bf req-157da363-2ae7-41e1-8b95-7a03a9b3f642 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:16.628765 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-334e6669-a194-4ddb-89de-3add54f3a1bf req-157da363-2ae7-41e1-8b95-7a03a9b3f642 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:16.639978 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-334e6669-a194-4ddb-89de-3add54f3a1bf req-157da363-2ae7-41e1-8b95-7a03a9b3f642 service nova] Creating event network-changed:de279c4f-9053-44d1-aa49-aa402574c2ed for instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 on hv-cinder-83608 Sep 15 13:04:16.645974 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-334e6669-a194-4ddb-89de-3add54f3a1bf req-157da363-2ae7-41e1-8b95-7a03a9b3f642 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090121 Sep 15 13:04:16.646571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 245/495] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:04:18.305804 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7926665d-87c6-488b-ae32-f0774487b857 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:04:18.312426 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7926665d-87c6-488b-ae32-f0774487b857 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:18.313100 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7926665d-87c6-488b-ae32-f0774487b857 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:18.313533 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7926665d-87c6-488b-ae32-f0774487b857 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:18.335899 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7926665d-87c6-488b-ae32-f0774487b857 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Going to try to stop instance {{(pid=120633) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 15 13:04:18.377934 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7926665d-87c6-488b-ae32-f0774487b857 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "POST /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/action" status: 202 len: 0 microversion: 2.1 time: 0.076044 Sep 15 13:04:18.378460 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 251/496] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Sep 15 13:04:18 2022] POST /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:04:18.387299 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a42aa49c-45bd-4577-891f-835bf587288c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:18.388067 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a42aa49c-45bd-4577-891f-835bf587288c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:18.394861 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a42aa49c-45bd-4577-891f-835bf587288c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:18.395349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a42aa49c-45bd-4577-891f-835bf587288c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:18.395785 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a42aa49c-45bd-4577-891f-835bf587288c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:18.396548 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a42aa49c-45bd-4577-891f-835bf587288c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:18.397001 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a42aa49c-45bd-4577-891f-835bf587288c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:18.397423 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a42aa49c-45bd-4577-891f-835bf587288c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:18.532621 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a42aa49c-45bd-4577-891f-835bf587288c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:18.540218 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a42aa49c-45bd-4577-891f-835bf587288c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.157366 Sep 15 13:04:18.540807 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 246/497] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:18 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:18.661176 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-8e33d57c-3f85-4b69-aa9c-07d484c0c248 req-0b6b96d0-8161-4c23-9cf1-58a8f787096f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4ff8111-8ab2-4e8d-8278-f76f69b76196", "tag": "de279c4f-9053-44d1-aa49-aa402574c2ed"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:04:18.670628 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-8e33d57c-3f85-4b69-aa9c-07d484c0c248 req-0b6b96d0-8161-4c23-9cf1-58a8f787096f service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:18.671102 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-8e33d57c-3f85-4b69-aa9c-07d484c0c248 req-0b6b96d0-8161-4c23-9cf1-58a8f787096f service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:18.671523 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-8e33d57c-3f85-4b69-aa9c-07d484c0c248 req-0b6b96d0-8161-4c23-9cf1-58a8f787096f service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:18.682298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-8e33d57c-3f85-4b69-aa9c-07d484c0c248 req-0b6b96d0-8161-4c23-9cf1-58a8f787096f service nova] Creating event network-changed:de279c4f-9053-44d1-aa49-aa402574c2ed for instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 on hv-cinder-83608 Sep 15 13:04:18.686943 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-8e33d57c-3f85-4b69-aa9c-07d484c0c248 req-0b6b96d0-8161-4c23-9cf1-58a8f787096f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030394 Sep 15 13:04:18.687498 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 252/498] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:04:19.563718 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-542df0dc-8fa9-4d5c-b50a-d819c9d27b89 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:19.564289 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-542df0dc-8fa9-4d5c-b50a-d819c9d27b89 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:19.570187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-542df0dc-8fa9-4d5c-b50a-d819c9d27b89 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:19.570670 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-542df0dc-8fa9-4d5c-b50a-d819c9d27b89 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:19.571102 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-542df0dc-8fa9-4d5c-b50a-d819c9d27b89 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:19.571786 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-542df0dc-8fa9-4d5c-b50a-d819c9d27b89 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:19.572243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-542df0dc-8fa9-4d5c-b50a-d819c9d27b89 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:19.572714 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-542df0dc-8fa9-4d5c-b50a-d819c9d27b89 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:19.697980 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-542df0dc-8fa9-4d5c-b50a-d819c9d27b89 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:19.705848 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-542df0dc-8fa9-4d5c-b50a-d819c9d27b89 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.146172 Sep 15 13:04:19.706403 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 247/499] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:19 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:20.730475 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4a57e5d3-305f-45dd-b9e3-05128dd79e44 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:20.731176 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-4a57e5d3-305f-45dd-b9e3-05128dd79e44 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:20.737409 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4a57e5d3-305f-45dd-b9e3-05128dd79e44 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:20.737892 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4a57e5d3-305f-45dd-b9e3-05128dd79e44 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:20.738328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4a57e5d3-305f-45dd-b9e3-05128dd79e44 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:20.739039 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4a57e5d3-305f-45dd-b9e3-05128dd79e44 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:20.739490 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4a57e5d3-305f-45dd-b9e3-05128dd79e44 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:20.739910 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4a57e5d3-305f-45dd-b9e3-05128dd79e44 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:20.871430 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4a57e5d3-305f-45dd-b9e3-05128dd79e44 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:20.879443 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-4a57e5d3-305f-45dd-b9e3-05128dd79e44 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.153794 Sep 15 13:04:20.880003 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 253/500] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:20 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:21.903110 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5073b92d-150a-41a9-9032-4634b1dc7195 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:21.903755 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5073b92d-150a-41a9-9032-4634b1dc7195 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:21.910519 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5073b92d-150a-41a9-9032-4634b1dc7195 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:21.911002 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5073b92d-150a-41a9-9032-4634b1dc7195 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:21.911445 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5073b92d-150a-41a9-9032-4634b1dc7195 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:21.912138 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5073b92d-150a-41a9-9032-4634b1dc7195 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:21.912615 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5073b92d-150a-41a9-9032-4634b1dc7195 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:21.913038 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5073b92d-150a-41a9-9032-4634b1dc7195 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:22.042204 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5073b92d-150a-41a9-9032-4634b1dc7195 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:22.051141 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5073b92d-150a-41a9-9032-4634b1dc7195 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.151890 Sep 15 13:04:22.051706 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 248/501] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:21 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:23.074284 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-efebb034-85bd-4257-a39b-06e25500ac2a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:23.074886 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-efebb034-85bd-4257-a39b-06e25500ac2a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:23.081725 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efebb034-85bd-4257-a39b-06e25500ac2a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:23.082209 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efebb034-85bd-4257-a39b-06e25500ac2a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:23.082636 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efebb034-85bd-4257-a39b-06e25500ac2a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:23.083320 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efebb034-85bd-4257-a39b-06e25500ac2a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:23.083775 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efebb034-85bd-4257-a39b-06e25500ac2a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:23.084185 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-efebb034-85bd-4257-a39b-06e25500ac2a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:23.210538 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-efebb034-85bd-4257-a39b-06e25500ac2a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:23.218135 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-efebb034-85bd-4257-a39b-06e25500ac2a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.147680 Sep 15 13:04:23.218783 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 254/502] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:23 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:24.240780 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5b98cb56-c6b8-4e28-82a5-cecd0003ed63 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:24.241384 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5b98cb56-c6b8-4e28-82a5-cecd0003ed63 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:24.247458 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5b98cb56-c6b8-4e28-82a5-cecd0003ed63 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:24.247933 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5b98cb56-c6b8-4e28-82a5-cecd0003ed63 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:24.248383 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5b98cb56-c6b8-4e28-82a5-cecd0003ed63 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:24.249064 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5b98cb56-c6b8-4e28-82a5-cecd0003ed63 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:24.249508 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5b98cb56-c6b8-4e28-82a5-cecd0003ed63 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:24.250771 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5b98cb56-c6b8-4e28-82a5-cecd0003ed63 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:24.377469 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5b98cb56-c6b8-4e28-82a5-cecd0003ed63 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:24.385505 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5b98cb56-c6b8-4e28-82a5-cecd0003ed63 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.148617 Sep 15 13:04:24.386069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 249/503] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:24 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:25.409034 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-fe2309f9-d2ea-4934-adad-031db7c83735 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:25.409553 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-fe2309f9-d2ea-4934-adad-031db7c83735 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:25.415879 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe2309f9-d2ea-4934-adad-031db7c83735 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:25.416401 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe2309f9-d2ea-4934-adad-031db7c83735 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:25.416832 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe2309f9-d2ea-4934-adad-031db7c83735 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:25.417545 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe2309f9-d2ea-4934-adad-031db7c83735 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:25.417991 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe2309f9-d2ea-4934-adad-031db7c83735 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:25.418406 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe2309f9-d2ea-4934-adad-031db7c83735 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:25.549980 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-fe2309f9-d2ea-4934-adad-031db7c83735 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:25.557779 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-fe2309f9-d2ea-4934-adad-031db7c83735 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.152719 Sep 15 13:04:25.558356 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 255/504] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:25 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:26.581688 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6616aeae-7cbb-4b51-b580-2bb738543f5f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:26.582323 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6616aeae-7cbb-4b51-b580-2bb738543f5f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:26.588297 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6616aeae-7cbb-4b51-b580-2bb738543f5f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:26.588797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6616aeae-7cbb-4b51-b580-2bb738543f5f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:26.589227 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6616aeae-7cbb-4b51-b580-2bb738543f5f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:26.590004 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6616aeae-7cbb-4b51-b580-2bb738543f5f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:26.590453 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6616aeae-7cbb-4b51-b580-2bb738543f5f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:26.590868 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6616aeae-7cbb-4b51-b580-2bb738543f5f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:26.719945 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6616aeae-7cbb-4b51-b580-2bb738543f5f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:26.727624 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6616aeae-7cbb-4b51-b580-2bb738543f5f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.150286 Sep 15 13:04:26.728188 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 250/505] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:26 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:27.751106 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9c50cf21-6e28-429e-bb42-249ab63d959f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:27.751721 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9c50cf21-6e28-429e-bb42-249ab63d959f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:27.758785 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9c50cf21-6e28-429e-bb42-249ab63d959f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:27.759264 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9c50cf21-6e28-429e-bb42-249ab63d959f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:27.759692 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9c50cf21-6e28-429e-bb42-249ab63d959f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:27.760408 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9c50cf21-6e28-429e-bb42-249ab63d959f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:27.760853 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9c50cf21-6e28-429e-bb42-249ab63d959f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:27.761267 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9c50cf21-6e28-429e-bb42-249ab63d959f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:27.892950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9c50cf21-6e28-429e-bb42-249ab63d959f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:27.900798 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9c50cf21-6e28-429e-bb42-249ab63d959f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.153525 Sep 15 13:04:27.901374 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 256/506] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:27 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:28.562546 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-782e229d-6772-42bf-adaa-ba173149d633 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:28.563207 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-782e229d-6772-42bf-adaa-ba173149d633 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:28.569074 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-782e229d-6772-42bf-adaa-ba173149d633 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:28.569547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-782e229d-6772-42bf-adaa-ba173149d633 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:28.569971 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-782e229d-6772-42bf-adaa-ba173149d633 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:28.570652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-782e229d-6772-42bf-adaa-ba173149d633 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:28.571093 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-782e229d-6772-42bf-adaa-ba173149d633 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:28.571508 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-782e229d-6772-42bf-adaa-ba173149d633 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:28.595225 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-782e229d-6772-42bf-adaa-ba173149d633 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4/ips" status: 200 len: 151 microversion: 2.1 time: 0.085827 Sep 15 13:04:28.595763 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 251/507] 10.222.0.57 () {58 vars in 1248 bytes} [Thu Sep 15 13:04:28 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4/ips => generated 151 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:04:28.608469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5d4f2947-a987-4933-af02-d846a969fe92 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "159f754b-7c48-4a32-a015-cf79360e219c"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:04:28.611217 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-5d4f2947-a987-4933-af02-d846a969fe92 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:28.617329 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5d4f2947-a987-4933-af02-d846a969fe92 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:28.617804 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5d4f2947-a987-4933-af02-d846a969fe92 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:28.618239 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5d4f2947-a987-4933-af02-d846a969fe92 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:28.618920 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5d4f2947-a987-4933-af02-d846a969fe92 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:28.619369 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5d4f2947-a987-4933-af02-d846a969fe92 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:28.619788 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5d4f2947-a987-4933-af02-d846a969fe92 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:28.698974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-5d4f2947-a987-4933-af02-d846a969fe92 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] HTTP exception thrown: Invalid volume: volume 159f754b-7c48-4a32-a015-cf79360e219c is already attached to instances: 7a48c801-810d-4702-a905-a6109e4786d8 Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5d4f2947-a987-4933-af02-d846a969fe92 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Request method failure captured: Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: POST /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4/os-volume_attachments HTTP/1.1 Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 74 Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyF7i7azu69ujLWg4VmTaNmO_zlpZPMUNTZrbMEnkSIYxAt8-6t89_4emnOqEbXOd0vYTcUpuPUNe1odpy6Z_A42YWyOg_xfXoVm1614XjjnNtx-GDPzKOh0QDXFBzLzkRmidRDvMrs8mjeXHDo1r_RSCgjMCh8MlbrqEaex6H5lClc Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:04:28.700737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:04:28.702294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e4c4dc894bd429b8f46ae444eb5ff7d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}] Sep 15 13:04:28.702294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:04:28.702294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:04:28.702294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:04:28.702294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:04:28.702294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:04:28.702294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:04:28.702294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: cd22d2df9ced4bb0961596385854422d Sep 15 13:04:28.702294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:04:28.702294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Sep 15 13:04:28.702294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {"volumeAttachment": {"volumeId": "159f754b-7c48-4a32-a015-cf79360e219c"}} Sep 15 13:04:28.702294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Invalid volume: volume 159f754b-7c48-4a32-a015-cf79360e219c is already attached to instances: 7a48c801-810d-4702-a905-a6109e4786d8 Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'server_id': '5170c49a-0d2d-487f-abc1-2cc80ebb31b4', 'body': {'volumeAttachment': {'volumeId': '159f754b-7c48-4a32-a015-cf79360e219c'}}} Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 159f754b-7c48-4a32-a015-cf79360e219c is already attached to instances: 7a48c801-810d-4702-a905-a6109e4786d8 Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:28.704931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 159f754b-7c48-4a32-a015-cf79360e219c is already attached to instances: 7a48c801-810d-4702-a905-a6109e4786d8 Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:04:28.706293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:04:28.707687 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:04:28.707687 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:04:28.707687 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:04:28.707687 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 159f754b-7c48-4a32-a015-cf79360e219c is already attached to instances: 7a48c801-810d-4702-a905-a6109e4786d8 Sep 15 13:04:28.707687 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:28.707687 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5d4f2947-a987-4933-af02-d846a969fe92 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Returning 400 to user: Invalid volume: volume 159f754b-7c48-4a32-a015-cf79360e219c is already attached to instances: 7a48c801-810d-4702-a905-a6109e4786d8 {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:04:28.707687 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-5d4f2947-a987-4933-af02-d846a969fe92 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "POST /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097702 Sep 15 13:04:28.707687 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 257/508] 10.222.0.57 () {60 vars in 1323 bytes} [Thu Sep 15 13:04:28 2022] POST /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 13:04:28.712025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6be6c28b-bb2d-4679-a9ac-b4328390f97c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:28.712546 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6be6c28b-bb2d-4679-a9ac-b4328390f97c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:28.718365 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6be6c28b-bb2d-4679-a9ac-b4328390f97c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:28.719126 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6be6c28b-bb2d-4679-a9ac-b4328390f97c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:28.719563 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6be6c28b-bb2d-4679-a9ac-b4328390f97c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:28.720244 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6be6c28b-bb2d-4679-a9ac-b4328390f97c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:28.720730 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6be6c28b-bb2d-4679-a9ac-b4328390f97c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:28.721150 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6be6c28b-bb2d-4679-a9ac-b4328390f97c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:28.747058 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6be6c28b-bb2d-4679-a9ac-b4328390f97c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Going to try to terminate instance {{(pid=120634) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:04:28.820865 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6be6c28b-bb2d-4679-a9ac-b4328390f97c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 204 len: 0 microversion: 2.1 time: 0.112272 Sep 15 13:04:28.821341 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 252/509] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:04:28 2022] DELETE /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:04:28.830428 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2f8f6df2-4f0e-4d46-9da8-dc336184a95f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:28.831051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2f8f6df2-4f0e-4d46-9da8-dc336184a95f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:28.838571 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2f8f6df2-4f0e-4d46-9da8-dc336184a95f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:28.839060 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2f8f6df2-4f0e-4d46-9da8-dc336184a95f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:28.839497 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2f8f6df2-4f0e-4d46-9da8-dc336184a95f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:28.840219 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2f8f6df2-4f0e-4d46-9da8-dc336184a95f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:28.840700 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2f8f6df2-4f0e-4d46-9da8-dc336184a95f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:28.841124 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2f8f6df2-4f0e-4d46-9da8-dc336184a95f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:28.924600 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-21ad7235-3df0-43bd-9590-a1610bc592dc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:28.925446 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-21ad7235-3df0-43bd-9590-a1610bc592dc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:28.931525 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-21ad7235-3df0-43bd-9590-a1610bc592dc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:28.932014 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-21ad7235-3df0-43bd-9590-a1610bc592dc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:28.932476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-21ad7235-3df0-43bd-9590-a1610bc592dc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:28.933181 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-21ad7235-3df0-43bd-9590-a1610bc592dc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:28.933629 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-21ad7235-3df0-43bd-9590-a1610bc592dc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:28.934052 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-21ad7235-3df0-43bd-9590-a1610bc592dc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:28.969673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2f8f6df2-4f0e-4d46-9da8-dc336184a95f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:28.977466 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2f8f6df2-4f0e-4d46-9da8-dc336184a95f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1681 microversion: 2.1 time: 0.151681 Sep 15 13:04:28.978513 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 258/510] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:28 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:29.066709 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-21ad7235-3df0-43bd-9590-a1610bc592dc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:29.074321 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-21ad7235-3df0-43bd-9590-a1610bc592dc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.154735 Sep 15 13:04:29.074818 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 253/511] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:28 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:04:30.003176 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-83936837-4834-409f-a92f-736e85058931 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:30.003783 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-83936837-4834-409f-a92f-736e85058931 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:30.005997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=36 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:30.011422 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-83936837-4834-409f-a92f-736e85058931 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:30.011899 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-83936837-4834-409f-a92f-736e85058931 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:30.012351 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-83936837-4834-409f-a92f-736e85058931 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:30.013032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-83936837-4834-409f-a92f-736e85058931 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:30.013475 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-83936837-4834-409f-a92f-736e85058931 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:30.013888 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-83936837-4834-409f-a92f-736e85058931 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:30.098646 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-57003e32-c02d-4590-97b9-e9d013e66c06 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:30.099334 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-57003e32-c02d-4590-97b9-e9d013e66c06 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:30.105575 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-57003e32-c02d-4590-97b9-e9d013e66c06 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:30.106145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-57003e32-c02d-4590-97b9-e9d013e66c06 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:30.106654 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-57003e32-c02d-4590-97b9-e9d013e66c06 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:30.107421 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-57003e32-c02d-4590-97b9-e9d013e66c06 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:30.107971 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-57003e32-c02d-4590-97b9-e9d013e66c06 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:30.108500 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-57003e32-c02d-4590-97b9-e9d013e66c06 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:30.146327 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-83936837-4834-409f-a92f-736e85058931 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:30.154120 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-83936837-4834-409f-a92f-736e85058931 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1681 microversion: 2.1 time: 0.155477 Sep 15 13:04:30.154703 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 259/512] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:29 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:30.244340 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-57003e32-c02d-4590-97b9-e9d013e66c06 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:30.254744 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-57003e32-c02d-4590-97b9-e9d013e66c06 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.160070 Sep 15 13:04:30.255306 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 254/513] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:30 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:04:31.177591 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a374d040-a98f-4320-b32d-96d48e5be915 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:31.178174 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a374d040-a98f-4320-b32d-96d48e5be915 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:31.184518 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a374d040-a98f-4320-b32d-96d48e5be915 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:31.184998 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a374d040-a98f-4320-b32d-96d48e5be915 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:31.185425 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a374d040-a98f-4320-b32d-96d48e5be915 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:31.186104 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a374d040-a98f-4320-b32d-96d48e5be915 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:31.186551 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a374d040-a98f-4320-b32d-96d48e5be915 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:31.187616 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a374d040-a98f-4320-b32d-96d48e5be915 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:31.278812 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-33f45e70-6adf-4113-9a3e-691f7bfb5d41 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:31.279518 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-33f45e70-6adf-4113-9a3e-691f7bfb5d41 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:31.281711 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:31.288171 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-33f45e70-6adf-4113-9a3e-691f7bfb5d41 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:31.288514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-33f45e70-6adf-4113-9a3e-691f7bfb5d41 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:31.289027 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-33f45e70-6adf-4113-9a3e-691f7bfb5d41 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:31.289804 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-33f45e70-6adf-4113-9a3e-691f7bfb5d41 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:31.290346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-33f45e70-6adf-4113-9a3e-691f7bfb5d41 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:31.290843 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-33f45e70-6adf-4113-9a3e-691f7bfb5d41 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:31.319003 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a374d040-a98f-4320-b32d-96d48e5be915 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:31.326792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a374d040-a98f-4320-b32d-96d48e5be915 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1681 microversion: 2.1 time: 0.153072 Sep 15 13:04:31.327632 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 260/514] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:31 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:31.494740 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-33f45e70-6adf-4113-9a3e-691f7bfb5d41 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:31.504487 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-33f45e70-6adf-4113-9a3e-691f7bfb5d41 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.229442 Sep 15 13:04:31.505060 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 255/515] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:31 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:04:32.148732 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-2c3c792c-dfb6-4400-b655-c2e19860f4ac req-f9500c43-b0be-443e-aa05-cea22ef23754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5170c49a-0d2d-487f-abc1-2cc80ebb31b4", "name": "network-vif-deleted", "tag": "a40c3efd-d157-4cf4-9c28-2e3f09f142e7"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:04:32.162089 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-2c3c792c-dfb6-4400-b655-c2e19860f4ac req-f9500c43-b0be-443e-aa05-cea22ef23754 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:32.162607 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-2c3c792c-dfb6-4400-b655-c2e19860f4ac req-f9500c43-b0be-443e-aa05-cea22ef23754 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:32.163039 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-2c3c792c-dfb6-4400-b655-c2e19860f4ac req-f9500c43-b0be-443e-aa05-cea22ef23754 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:32.176091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-2c3c792c-dfb6-4400-b655-c2e19860f4ac req-f9500c43-b0be-443e-aa05-cea22ef23754 service nova] Creating event network-vif-deleted:a40c3efd-d157-4cf4-9c28-2e3f09f142e7 for instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 on hv-cinder-83608 Sep 15 13:04:32.181542 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-2c3c792c-dfb6-4400-b655-c2e19860f4ac req-f9500c43-b0be-443e-aa05-cea22ef23754 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036267 Sep 15 13:04:32.182466 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 261/516] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:04:32.351770 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6426ddbc-b77f-46a3-b376-71667d5cd871 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:32.353017 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6426ddbc-b77f-46a3-b376-71667d5cd871 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:32.360650 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6426ddbc-b77f-46a3-b376-71667d5cd871 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:32.361391 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6426ddbc-b77f-46a3-b376-71667d5cd871 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:32.362002 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6426ddbc-b77f-46a3-b376-71667d5cd871 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:32.363028 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6426ddbc-b77f-46a3-b376-71667d5cd871 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:32.363635 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6426ddbc-b77f-46a3-b376-71667d5cd871 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:32.364212 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6426ddbc-b77f-46a3-b376-71667d5cd871 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:32.414173 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6426ddbc-b77f-46a3-b376-71667d5cd871 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:32.414658 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6426ddbc-b77f-46a3-b376-71667d5cd871 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:32.417084 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6426ddbc-b77f-46a3-b376-71667d5cd871 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:32.417550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-6426ddbc-b77f-46a3-b376-71667d5cd871 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lazy-loading 'fault' on Instance uuid 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:04:32.460964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6426ddbc-b77f-46a3-b376-71667d5cd871 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:32.469462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6426ddbc-b77f-46a3-b376-71667d5cd871 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 200 len: 1329 microversion: 2.1 time: 0.121480 Sep 15 13:04:32.478542 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 256/517] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:32 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 1329 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:32.529313 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c3221395-c6d5-40f6-b6f0-1a8e055887b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:32.530262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c3221395-c6d5-40f6-b6f0-1a8e055887b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:32.539241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c3221395-c6d5-40f6-b6f0-1a8e055887b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:32.539807 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c3221395-c6d5-40f6-b6f0-1a8e055887b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:32.541824 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c3221395-c6d5-40f6-b6f0-1a8e055887b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:32.543644 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c3221395-c6d5-40f6-b6f0-1a8e055887b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:32.544433 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c3221395-c6d5-40f6-b6f0-1a8e055887b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:32.545622 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c3221395-c6d5-40f6-b6f0-1a8e055887b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:32.713066 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c3221395-c6d5-40f6-b6f0-1a8e055887b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:32.717273 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:32.724465 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c3221395-c6d5-40f6-b6f0-1a8e055887b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.201195 Sep 15 13:04:32.725158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 262/518] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:32 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:33.492209 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-919f3133-da3e-4fb8-b659-c37dadeb32eb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:33.492854 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-919f3133-da3e-4fb8-b659-c37dadeb32eb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:33.498989 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-919f3133-da3e-4fb8-b659-c37dadeb32eb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:33.499574 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-919f3133-da3e-4fb8-b659-c37dadeb32eb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:33.500014 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-919f3133-da3e-4fb8-b659-c37dadeb32eb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:33.500766 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-919f3133-da3e-4fb8-b659-c37dadeb32eb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:33.501239 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-919f3133-da3e-4fb8-b659-c37dadeb32eb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:33.501655 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-919f3133-da3e-4fb8-b659-c37dadeb32eb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:33.516170 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-919f3133-da3e-4fb8-b659-c37dadeb32eb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] HTTP exception thrown: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-919f3133-da3e-4fb8-b659-c37dadeb32eb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Request method failure captured: Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 HTTP/1.1 Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyF7i7azu69ujLWg4VmTaNmO_zlpZPMUNTZrbMEnkSIYxAt8-6t89_4emnOqEbXOd0vYTcUpuPUNe1odpy6Z_A42YWyOg_xfXoVm1614XjjnNtx-GDPzKOh0QDXFBzLzkRmidRDvMrs8mjeXHDo1r_RSCgjMCh8MlbrqEaex6H5lClc Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:04:33.517803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:04:33.519652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e4c4dc894bd429b8f46ae444eb5ff7d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}] Sep 15 13:04:33.519652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:04:33.519652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:04:33.519652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:04:33.519652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:04:33.519652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:04:33.519652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:04:33.519652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: cd22d2df9ced4bb0961596385854422d Sep 15 13:04:33.519652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:04:33.519652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:04:33.519652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:04:33.519652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': '5170c49a-0d2d-487f-abc1-2cc80ebb31b4'} Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:04:33.520476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:04:33.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:04:33.523357 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-919f3133-da3e-4fb8-b659-c37dadeb32eb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Returning 404 to user: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:04:33.523357 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-919f3133-da3e-4fb8-b659-c37dadeb32eb tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 404 len: 111 microversion: 2.1 time: 0.031030 Sep 15 13:04:33.523357 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 257/519] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:33 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:04:33.528325 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8753c153-ae22-418f-9c05-4bfe9acfb6ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '.version_select at 0x7f62c5572dc0>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:33.549370 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8753c153-ae22-418f-9c05-4bfe9acfb6ba tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-43585664" status: 202 len: 0 microversion: 2.1 time: 0.024735 Sep 15 13:04:33.549923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 263/520] 10.222.0.57 () {58 vars in 1215 bytes} [Thu Sep 15 13:04:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-43585664 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 13:04:33.746913 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d150154e-4d6b-4e3a-b5f1-696f321cf0f6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:33.747533 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d150154e-4d6b-4e3a-b5f1-696f321cf0f6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:33.754135 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d150154e-4d6b-4e3a-b5f1-696f321cf0f6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:33.754623 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d150154e-4d6b-4e3a-b5f1-696f321cf0f6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:33.755274 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d150154e-4d6b-4e3a-b5f1-696f321cf0f6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:33.755982 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d150154e-4d6b-4e3a-b5f1-696f321cf0f6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:33.756489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d150154e-4d6b-4e3a-b5f1-696f321cf0f6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:33.756900 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d150154e-4d6b-4e3a-b5f1-696f321cf0f6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:33.775303 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:33.893546 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d150154e-4d6b-4e3a-b5f1-696f321cf0f6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:33.901838 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d150154e-4d6b-4e3a-b5f1-696f321cf0f6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.158744 Sep 15 13:04:33.902409 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 258/521] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:33 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:34.264823 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cf413ac1-d1e1-4b67-a5cc-73215f61b339 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:34.265358 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cf413ac1-d1e1-4b67-a5cc-73215f61b339 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:34.272035 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf413ac1-d1e1-4b67-a5cc-73215f61b339 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:34.272553 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf413ac1-d1e1-4b67-a5cc-73215f61b339 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:34.272990 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf413ac1-d1e1-4b67-a5cc-73215f61b339 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:34.273679 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf413ac1-d1e1-4b67-a5cc-73215f61b339 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:34.274135 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf413ac1-d1e1-4b67-a5cc-73215f61b339 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:34.274559 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf413ac1-d1e1-4b67-a5cc-73215f61b339 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:34.355982 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-cf413ac1-d1e1-4b67-a5cc-73215f61b339 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lazy-loading 'services' on Instance uuid 7a48c801-810d-4702-a905-a6109e4786d8 {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:04:34.430024 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cf413ac1-d1e1-4b67-a5cc-73215f61b339 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8/os-volume_attachments/159f754b-7c48-4a32-a015-cf79360e219c" status: 202 len: 0 microversion: 2.1 time: 0.168943 Sep 15 13:04:34.430782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 264/522] 10.222.0.57 () {58 vars in 1416 bytes} [Thu Sep 15 13:04:34 2022] DELETE /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8/os-volume_attachments/159f754b-7c48-4a32-a015-cf79360e219c => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:04:34.439297 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-000e1894-8029-4141-99c9-1e3ed614654b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:34.441787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-000e1894-8029-4141-99c9-1e3ed614654b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:34.448179 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-000e1894-8029-4141-99c9-1e3ed614654b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:34.448778 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-000e1894-8029-4141-99c9-1e3ed614654b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:34.449268 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-000e1894-8029-4141-99c9-1e3ed614654b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:34.450111 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-000e1894-8029-4141-99c9-1e3ed614654b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:34.450572 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-000e1894-8029-4141-99c9-1e3ed614654b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:34.450975 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-000e1894-8029-4141-99c9-1e3ed614654b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:34.481442 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-000e1894-8029-4141-99c9-1e3ed614654b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046229 Sep 15 13:04:34.481958 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 259/523] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:04:34 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:04:34.926075 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c1879097-4ddd-43c5-a037-222a10cce3bc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:34.926688 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c1879097-4ddd-43c5-a037-222a10cce3bc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:34.933394 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c1879097-4ddd-43c5-a037-222a10cce3bc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:34.933886 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c1879097-4ddd-43c5-a037-222a10cce3bc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:34.934320 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c1879097-4ddd-43c5-a037-222a10cce3bc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:34.935010 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c1879097-4ddd-43c5-a037-222a10cce3bc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:34.935460 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c1879097-4ddd-43c5-a037-222a10cce3bc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:34.935884 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c1879097-4ddd-43c5-a037-222a10cce3bc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:35.070342 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c1879097-4ddd-43c5-a037-222a10cce3bc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:35.079842 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c1879097-4ddd-43c5-a037-222a10cce3bc tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.158693 Sep 15 13:04:35.080542 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 265/524] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:34 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:35.493148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-27ad1ad4-32f0-48b7-86a1-58e15549fbc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:35.495351 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-27ad1ad4-32f0-48b7-86a1-58e15549fbc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:35.501873 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-27ad1ad4-32f0-48b7-86a1-58e15549fbc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:35.502349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-27ad1ad4-32f0-48b7-86a1-58e15549fbc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:35.502782 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-27ad1ad4-32f0-48b7-86a1-58e15549fbc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:35.503464 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-27ad1ad4-32f0-48b7-86a1-58e15549fbc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:35.503913 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-27ad1ad4-32f0-48b7-86a1-58e15549fbc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:35.504480 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-27ad1ad4-32f0-48b7-86a1-58e15549fbc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:35.533465 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-27ad1ad4-32f0-48b7-86a1-58e15549fbc5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044337 Sep 15 13:04:35.534014 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 260/525] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:04:35 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 13:04:35.596615 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cf9ccad6-7f09-4e97-9082-18b4db526ec1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:35.597109 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cf9ccad6-7f09-4e97-9082-18b4db526ec1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:35.602985 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf9ccad6-7f09-4e97-9082-18b4db526ec1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:35.603464 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf9ccad6-7f09-4e97-9082-18b4db526ec1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:35.603896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf9ccad6-7f09-4e97-9082-18b4db526ec1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:35.604619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf9ccad6-7f09-4e97-9082-18b4db526ec1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:35.605097 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf9ccad6-7f09-4e97-9082-18b4db526ec1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:35.605521 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf9ccad6-7f09-4e97-9082-18b4db526ec1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:35.630056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cf9ccad6-7f09-4e97-9082-18b4db526ec1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Going to try to terminate instance {{(pid=120633) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:04:35.712643 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cf9ccad6-7f09-4e97-9082-18b4db526ec1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 204 len: 0 microversion: 2.1 time: 0.119412 Sep 15 13:04:35.713234 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 266/526] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:04:35 2022] DELETE /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:04:35.722233 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-13f5e5e0-d00e-4fb3-afb3-35b5e42e226c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:35.722904 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-13f5e5e0-d00e-4fb3-afb3-35b5e42e226c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:35.728971 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13f5e5e0-d00e-4fb3-afb3-35b5e42e226c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:35.729452 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13f5e5e0-d00e-4fb3-afb3-35b5e42e226c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:35.729887 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13f5e5e0-d00e-4fb3-afb3-35b5e42e226c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:35.730571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13f5e5e0-d00e-4fb3-afb3-35b5e42e226c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:35.731023 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13f5e5e0-d00e-4fb3-afb3-35b5e42e226c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:35.731447 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13f5e5e0-d00e-4fb3-afb3-35b5e42e226c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:35.862109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-13f5e5e0-d00e-4fb3-afb3-35b5e42e226c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:35.869734 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-13f5e5e0-d00e-4fb3-afb3-35b5e42e226c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1683 microversion: 2.1 time: 0.152229 Sep 15 13:04:35.870298 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 261/527] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:35 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:36.104433 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cf0ba49a-6840-49a8-8bdd-8cf093064e67 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:36.105150 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cf0ba49a-6840-49a8-8bdd-8cf093064e67 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:36.111631 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf0ba49a-6840-49a8-8bdd-8cf093064e67 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:36.112111 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf0ba49a-6840-49a8-8bdd-8cf093064e67 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:36.112592 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf0ba49a-6840-49a8-8bdd-8cf093064e67 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:36.113347 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf0ba49a-6840-49a8-8bdd-8cf093064e67 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:36.113795 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf0ba49a-6840-49a8-8bdd-8cf093064e67 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:36.114213 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf0ba49a-6840-49a8-8bdd-8cf093064e67 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:36.244913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cf0ba49a-6840-49a8-8bdd-8cf093064e67 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:36.253129 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cf0ba49a-6840-49a8-8bdd-8cf093064e67 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.153022 Sep 15 13:04:36.253630 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 267/528] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:36 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:36.893641 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3052ac7d-3493-4f0a-aed4-c242131a0787 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:36.894523 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3052ac7d-3493-4f0a-aed4-c242131a0787 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:36.900453 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3052ac7d-3493-4f0a-aed4-c242131a0787 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:36.900936 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3052ac7d-3493-4f0a-aed4-c242131a0787 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:36.901365 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3052ac7d-3493-4f0a-aed4-c242131a0787 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:36.902055 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3052ac7d-3493-4f0a-aed4-c242131a0787 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:36.902497 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3052ac7d-3493-4f0a-aed4-c242131a0787 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:36.902918 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3052ac7d-3493-4f0a-aed4-c242131a0787 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:37.129339 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3052ac7d-3493-4f0a-aed4-c242131a0787 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:37.137152 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3052ac7d-3493-4f0a-aed4-c242131a0787 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1683 microversion: 2.1 time: 0.248052 Sep 15 13:04:37.137826 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 262/529] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:36 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1683 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:37.276345 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ddc0622e-9368-42ad-8a16-48619f11d731 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:37.276958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ddc0622e-9368-42ad-8a16-48619f11d731 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:37.286017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ddc0622e-9368-42ad-8a16-48619f11d731 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:37.286796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ddc0622e-9368-42ad-8a16-48619f11d731 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:37.287235 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ddc0622e-9368-42ad-8a16-48619f11d731 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:37.288367 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ddc0622e-9368-42ad-8a16-48619f11d731 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:37.288822 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ddc0622e-9368-42ad-8a16-48619f11d731 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:37.289240 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ddc0622e-9368-42ad-8a16-48619f11d731 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:37.431411 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ddc0622e-9368-42ad-8a16-48619f11d731 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:37.442275 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ddc0622e-9368-42ad-8a16-48619f11d731 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.169645 Sep 15 13:04:37.442921 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 268/530] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:37 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:37.685595 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-9bc00e78-907b-472f-a727-fb14363387ba req-66fd0043-c9f4-47c5-bc34-c5348674ed50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a48c801-810d-4702-a905-a6109e4786d8", "name": "network-vif-deleted", "tag": "15fae3ac-3d15-4151-bd85-4686ea0f64b1"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:04:37.694703 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-9bc00e78-907b-472f-a727-fb14363387ba req-66fd0043-c9f4-47c5-bc34-c5348674ed50 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:37.695189 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-9bc00e78-907b-472f-a727-fb14363387ba req-66fd0043-c9f4-47c5-bc34-c5348674ed50 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:37.695616 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-9bc00e78-907b-472f-a727-fb14363387ba req-66fd0043-c9f4-47c5-bc34-c5348674ed50 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:37.707996 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-9bc00e78-907b-472f-a727-fb14363387ba req-66fd0043-c9f4-47c5-bc34-c5348674ed50 service nova] Creating event network-vif-deleted:15fae3ac-3d15-4151-bd85-4686ea0f64b1 for instance 7a48c801-810d-4702-a905-a6109e4786d8 on hv-cinder-83608 Sep 15 13:04:37.713585 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-9bc00e78-907b-472f-a727-fb14363387ba req-66fd0043-c9f4-47c5-bc34-c5348674ed50 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032069 Sep 15 13:04:37.714560 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 263/531] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:04:38.161641 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-102c6b27-1768-4d6f-af86-df76ba506b8e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:38.162199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-102c6b27-1768-4d6f-af86-df76ba506b8e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:38.168061 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-102c6b27-1768-4d6f-af86-df76ba506b8e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:38.168579 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-102c6b27-1768-4d6f-af86-df76ba506b8e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:38.169018 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-102c6b27-1768-4d6f-af86-df76ba506b8e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:38.169711 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-102c6b27-1768-4d6f-af86-df76ba506b8e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:38.170165 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-102c6b27-1768-4d6f-af86-df76ba506b8e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:38.170626 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-102c6b27-1768-4d6f-af86-df76ba506b8e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:38.203172 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-102c6b27-1768-4d6f-af86-df76ba506b8e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:38.203661 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-102c6b27-1768-4d6f-af86-df76ba506b8e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:38.204097 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-102c6b27-1768-4d6f-af86-df76ba506b8e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:38.204582 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-102c6b27-1768-4d6f-af86-df76ba506b8e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lazy-loading 'fault' on Instance uuid 7a48c801-810d-4702-a905-a6109e4786d8 {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:04:38.250680 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-102c6b27-1768-4d6f-af86-df76ba506b8e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:38.258496 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-102c6b27-1768-4d6f-af86-df76ba506b8e tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 200 len: 1332 microversion: 2.1 time: 0.100972 Sep 15 13:04:38.259077 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 269/532] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:38 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:38.465873 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-7cdb1757-5213-41dc-a84a-67f911ec5594 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:38.466586 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-7cdb1757-5213-41dc-a84a-67f911ec5594 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:38.473642 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7cdb1757-5213-41dc-a84a-67f911ec5594 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:38.474307 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7cdb1757-5213-41dc-a84a-67f911ec5594 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:38.474930 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7cdb1757-5213-41dc-a84a-67f911ec5594 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:38.475759 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7cdb1757-5213-41dc-a84a-67f911ec5594 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:38.476251 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7cdb1757-5213-41dc-a84a-67f911ec5594 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:38.476703 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7cdb1757-5213-41dc-a84a-67f911ec5594 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:38.613776 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-7cdb1757-5213-41dc-a84a-67f911ec5594 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:38.622140 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-7cdb1757-5213-41dc-a84a-67f911ec5594 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1674 microversion: 2.1 time: 0.160659 Sep 15 13:04:38.622717 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 264/533] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:38 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:39.282590 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d7a71ff8-d9dc-409c-97ac-adad35fc344c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:39.283233 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d7a71ff8-d9dc-409c-97ac-adad35fc344c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:39.289701 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d7a71ff8-d9dc-409c-97ac-adad35fc344c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:39.290178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d7a71ff8-d9dc-409c-97ac-adad35fc344c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:39.290603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d7a71ff8-d9dc-409c-97ac-adad35fc344c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:39.291277 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d7a71ff8-d9dc-409c-97ac-adad35fc344c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:39.291721 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d7a71ff8-d9dc-409c-97ac-adad35fc344c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:39.292136 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d7a71ff8-d9dc-409c-97ac-adad35fc344c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:39.307324 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-d7a71ff8-d9dc-409c-97ac-adad35fc344c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] HTTP exception thrown: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d7a71ff8-d9dc-409c-97ac-adad35fc344c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Request method failure captured: Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 HTTP/1.1 Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyF7i7azu69ujLWg4VmTaNmO_zlpZPMUNTZrbMEnkSIYxAt8-6t89_4emnOqEbXOd0vYTcUpuPUNe1odpy6Z_A42YWyOg_xfXoVm1614XjjnNtx-GDPzKOh0QDXFBzLzkRmidRDvMrs8mjeXHDo1r_RSCgjMCh8MlbrqEaex6H5lClc Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:04:39.308958 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:04:39.310439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e4c4dc894bd429b8f46ae444eb5ff7d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}] Sep 15 13:04:39.310439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:04:39.310439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:04:39.310439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:04:39.310439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:04:39.310439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:04:39.310439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:04:39.310439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: cd22d2df9ced4bb0961596385854422d Sep 15 13:04:39.310439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:04:39.310439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:04:39.310439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:04:39.310439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '7a48c801-810d-4702-a905-a6109e4786d8'} Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:04:39.311194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:04:39.313328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:04:39.314802 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d7a71ff8-d9dc-409c-97ac-adad35fc344c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Returning 404 to user: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:04:39.314802 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d7a71ff8-d9dc-409c-97ac-adad35fc344c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 404 len: 111 microversion: 2.1 time: 0.031936 Sep 15 13:04:39.314802 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 270/534] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:39 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:04:39.319795 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-88ef513f-b383-446d-a4e8-d9cafa381898 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '.version_select at 0x7f62c55ec0d0>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:39.343324 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-88ef513f-b383-446d-a4e8-d9cafa381898 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1975026908" status: 202 len: 0 microversion: 2.1 time: 0.027320 Sep 15 13:04:39.344067 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 265/535] 10.222.0.57 () {58 vars in 1221 bytes} [Thu Sep 15 13:04:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1975026908 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 13:04:39.646768 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8b8074f9-2dcc-4cae-9dfa-94929fcc0551 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:39.647516 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-8b8074f9-2dcc-4cae-9dfa-94929fcc0551 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:39.653680 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8b8074f9-2dcc-4cae-9dfa-94929fcc0551 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:39.654161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8b8074f9-2dcc-4cae-9dfa-94929fcc0551 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:39.654591 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8b8074f9-2dcc-4cae-9dfa-94929fcc0551 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:39.655276 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8b8074f9-2dcc-4cae-9dfa-94929fcc0551 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:39.655865 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8b8074f9-2dcc-4cae-9dfa-94929fcc0551 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:39.656417 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8b8074f9-2dcc-4cae-9dfa-94929fcc0551 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:39.785031 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-8b8074f9-2dcc-4cae-9dfa-94929fcc0551 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:39.793269 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8b8074f9-2dcc-4cae-9dfa-94929fcc0551 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1651 microversion: 2.1 time: 0.150616 Sep 15 13:04:39.793833 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 271/536] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:39 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1651 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:39.816921 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-73c81e9b-18ea-463f-a255-ef4f6341e60e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:04:39.823014 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-73c81e9b-18ea-463f-a255-ef4f6341e60e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:39.823499 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-73c81e9b-18ea-463f-a255-ef4f6341e60e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:39.823930 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-73c81e9b-18ea-463f-a255-ef4f6341e60e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:39.847418 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-73c81e9b-18ea-463f-a255-ef4f6341e60e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Going to try to start instance {{(pid=120634) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 15 13:04:39.893844 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-73c81e9b-18ea-463f-a255-ef4f6341e60e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "POST /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/action" status: 202 len: 0 microversion: 2.1 time: 0.080617 Sep 15 13:04:39.895139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 266/537] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Sep 15 13:04:39 2022] POST /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 13:04:39.903225 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-724c509c-b1cb-47d2-9b0e-512fa1d552b8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:39.903967 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-724c509c-b1cb-47d2-9b0e-512fa1d552b8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:39.910748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-724c509c-b1cb-47d2-9b0e-512fa1d552b8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:39.911245 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-724c509c-b1cb-47d2-9b0e-512fa1d552b8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:39.911681 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-724c509c-b1cb-47d2-9b0e-512fa1d552b8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:39.912997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-724c509c-b1cb-47d2-9b0e-512fa1d552b8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:39.913704 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-724c509c-b1cb-47d2-9b0e-512fa1d552b8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:39.914291 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-724c509c-b1cb-47d2-9b0e-512fa1d552b8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:39.970452 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-041f1f0f-d30c-407a-9270-c61c6814f587 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Action: 'create', calling method: .version_select at 0x7f62c5717280>, body: {"keypair": {"name": "tempest-keypair-940171364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOl2hdpdtpMgfhqjj0e/0ezIk1GArne/6bQ/b8iYKbFyhy5TRzbUtz5IRoHtGihhIDZZOmgAK6Q96Rk4w797wsBwDF7JZiLUYo+7wnoCdOisKR3dZnJGWG+lGg4ZegoulQ=="}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:04:39.986505 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-041f1f0f-d30c-407a-9270-c61c6814f587 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'key_pairs'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:04:39.990521 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-041f1f0f-d30c-407a-9270-c61c6814f587 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for user cd22d2df9ced4bb0961596385854422d and project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'key_pairs'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:04:40.014504 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-041f1f0f-d30c-407a-9270-c61c6814f587 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048799 Sep 15 13:04:40.015535 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 267/538] 10.222.0.57 () {60 vars in 1159 bytes} [Thu Sep 15 13:04:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:04:40.058205 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-724c509c-b1cb-47d2-9b0e-512fa1d552b8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:40.067185 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-724c509c-b1cb-47d2-9b0e-512fa1d552b8 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1660 microversion: 2.1 time: 0.167959 Sep 15 13:04:40.067864 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 272/539] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:39 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1660 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:41.091632 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-88da11ba-33d9-4525-83d1-515ec2126955 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:41.093130 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-88da11ba-33d9-4525-83d1-515ec2126955 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:41.102368 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-88da11ba-33d9-4525-83d1-515ec2126955 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:41.102683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-88da11ba-33d9-4525-83d1-515ec2126955 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:41.103117 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-88da11ba-33d9-4525-83d1-515ec2126955 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:41.103822 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-88da11ba-33d9-4525-83d1-515ec2126955 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:41.104292 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-88da11ba-33d9-4525-83d1-515ec2126955 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:41.104744 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-88da11ba-33d9-4525-83d1-515ec2126955 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:41.251795 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-88da11ba-33d9-4525-83d1-515ec2126955 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:41.259761 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-88da11ba-33d9-4525-83d1-515ec2126955 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1660 microversion: 2.1 time: 0.172900 Sep 15 13:04:41.260693 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 268/540] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:41 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1660 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:41.451723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-765822098", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0e4d116-b42c-4d92-83e5-69793b91ec95"}], "security_groups": [{"name": "tempest-securitygroup--335226331"}], "key_name": "tempest-keypair-940171364", "user_data": "}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:04:41.571973 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.network.neutron [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] validate_networks() for [('e0e4d116-b42c-4d92-83e5-69793b91ec95', None, None, None, None, None)] {{(pid=120633) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:04:42.031756 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Flavor limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:04:42.032171 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Image limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:04:42.032668 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Flavor pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:04:42.033166 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Image pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:04:42.033603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:04:42.042832 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:42.043311 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:42.043741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:42.044488 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:42.044935 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:42.045494 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:42.063166 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:04:42.067210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for user cd22d2df9ced4bb0961596385854422d and project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:04:42.078929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Going to run 1 instances... {{(pid=120633) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:04:42.081262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:04:42.128906 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3ac27805-5419-4a56-a26a-c82db5dedcfa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.681474 Sep 15 13:04:42.129520 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 273/541] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:04:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 13:04:42.141595 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-38b6374c-e959-43fe-bc2c-147111f3d1aa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:42.142210 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-38b6374c-e959-43fe-bc2c-147111f3d1aa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:42.198037 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-38b6374c-e959-43fe-bc2c-147111f3d1aa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:42.205710 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-38b6374c-e959-43fe-bc2c-147111f3d1aa tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1240 microversion: 2.1 time: 0.068914 Sep 15 13:04:42.206505 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 269/542] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:42 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:42.286044 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0776d11b-369e-422b-bc09-06f14d3e5599 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:42.286746 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0776d11b-369e-422b-bc09-06f14d3e5599 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:42.292855 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0776d11b-369e-422b-bc09-06f14d3e5599 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:42.293430 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0776d11b-369e-422b-bc09-06f14d3e5599 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:42.293930 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0776d11b-369e-422b-bc09-06f14d3e5599 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:42.294626 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0776d11b-369e-422b-bc09-06f14d3e5599 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:42.295085 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0776d11b-369e-422b-bc09-06f14d3e5599 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:42.295505 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0776d11b-369e-422b-bc09-06f14d3e5599 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:42.429896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0776d11b-369e-422b-bc09-06f14d3e5599 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:42.438232 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0776d11b-369e-422b-bc09-06f14d3e5599 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1664 microversion: 2.1 time: 0.156012 Sep 15 13:04:42.438804 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 274/543] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:42 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:04:43.228332 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-53f297c5-5ccb-4de6-9683-ff3155cdfb84 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:43.228946 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-53f297c5-5ccb-4de6-9683-ff3155cdfb84 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:43.235067 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-53f297c5-5ccb-4de6-9683-ff3155cdfb84 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:43.235542 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-53f297c5-5ccb-4de6-9683-ff3155cdfb84 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:43.235973 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-53f297c5-5ccb-4de6-9683-ff3155cdfb84 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:43.236678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-53f297c5-5ccb-4de6-9683-ff3155cdfb84 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:43.237126 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-53f297c5-5ccb-4de6-9683-ff3155cdfb84 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:43.237538 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-53f297c5-5ccb-4de6-9683-ff3155cdfb84 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:43.298240 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-53f297c5-5ccb-4de6-9683-ff3155cdfb84 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:43.305711 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-53f297c5-5ccb-4de6-9683-ff3155cdfb84 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1292 microversion: 2.1 time: 0.081269 Sep 15 13:04:43.306271 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 270/544] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:43 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1292 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:44.329926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ab139428-cc7d-439f-9592-8fc92ce4583c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:44.330549 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ab139428-cc7d-439f-9592-8fc92ce4583c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:44.337921 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab139428-cc7d-439f-9592-8fc92ce4583c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:44.338494 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab139428-cc7d-439f-9592-8fc92ce4583c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:44.338923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab139428-cc7d-439f-9592-8fc92ce4583c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:44.339614 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab139428-cc7d-439f-9592-8fc92ce4583c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:44.340070 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab139428-cc7d-439f-9592-8fc92ce4583c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:44.340558 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab139428-cc7d-439f-9592-8fc92ce4583c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:44.404460 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ab139428-cc7d-439f-9592-8fc92ce4583c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:44.412585 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ab139428-cc7d-439f-9592-8fc92ce4583c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1298 microversion: 2.1 time: 0.087304 Sep 15 13:04:44.413152 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 275/545] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:44 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:45.434953 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4ded784a-0bf2-41de-bded-1ec0dc38f0e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:45.435664 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-4ded784a-0bf2-41de-bded-1ec0dc38f0e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:45.442377 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4ded784a-0bf2-41de-bded-1ec0dc38f0e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:45.442868 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4ded784a-0bf2-41de-bded-1ec0dc38f0e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:45.443310 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4ded784a-0bf2-41de-bded-1ec0dc38f0e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:45.444013 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4ded784a-0bf2-41de-bded-1ec0dc38f0e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:45.444498 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4ded784a-0bf2-41de-bded-1ec0dc38f0e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:45.444914 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4ded784a-0bf2-41de-bded-1ec0dc38f0e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:45.477727 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-079cc227-fdee-4ad3-84b5-765512bb3fc5 req-96f07b63-1e22-4057-874f-650b1d450b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28efcba-b6d3-4758-b3ea-de3992bc888a", "tag": "a943f44d-916a-4082-948c-693f4078378e"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:04:45.489461 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-079cc227-fdee-4ad3-84b5-765512bb3fc5 req-96f07b63-1e22-4057-874f-650b1d450b5b service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:45.490168 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-079cc227-fdee-4ad3-84b5-765512bb3fc5 req-96f07b63-1e22-4057-874f-650b1d450b5b service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:45.490606 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-079cc227-fdee-4ad3-84b5-765512bb3fc5 req-96f07b63-1e22-4057-874f-650b1d450b5b service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:45.502916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-079cc227-fdee-4ad3-84b5-765512bb3fc5 req-96f07b63-1e22-4057-874f-650b1d450b5b service nova] Creating event network-changed:a943f44d-916a-4082-948c-693f4078378e for instance d28efcba-b6d3-4758-b3ea-de3992bc888a on hv-cinder-83608 Sep 15 13:04:45.507893 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-079cc227-fdee-4ad3-84b5-765512bb3fc5 req-96f07b63-1e22-4057-874f-650b1d450b5b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033760 Sep 15 13:04:45.508905 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 276/546] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:04:45.685561 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-4ded784a-0bf2-41de-bded-1ec0dc38f0e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:45.693479 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-4ded784a-0bf2-41de-bded-1ec0dc38f0e5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1365 microversion: 2.1 time: 0.262392 Sep 15 13:04:45.694055 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 271/547] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:45 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:46.718499 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d54e5555-50bc-4f6b-a95d-1572b0ac260d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:46.719193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d54e5555-50bc-4f6b-a95d-1572b0ac260d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:46.725278 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d54e5555-50bc-4f6b-a95d-1572b0ac260d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:46.725758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d54e5555-50bc-4f6b-a95d-1572b0ac260d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:46.726188 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d54e5555-50bc-4f6b-a95d-1572b0ac260d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:46.726870 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d54e5555-50bc-4f6b-a95d-1572b0ac260d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:46.727316 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d54e5555-50bc-4f6b-a95d-1572b0ac260d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:46.727734 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d54e5555-50bc-4f6b-a95d-1572b0ac260d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:46.857851 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d54e5555-50bc-4f6b-a95d-1572b0ac260d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:46.866291 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d54e5555-50bc-4f6b-a95d-1572b0ac260d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1365 microversion: 2.1 time: 0.153068 Sep 15 13:04:46.866859 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 277/548] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:46 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:47.888616 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ff33f731-ae3b-4af6-b33c-ddf4840bbe98 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:47.889210 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ff33f731-ae3b-4af6-b33c-ddf4840bbe98 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:47.895414 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ff33f731-ae3b-4af6-b33c-ddf4840bbe98 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:47.895886 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ff33f731-ae3b-4af6-b33c-ddf4840bbe98 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:47.896336 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ff33f731-ae3b-4af6-b33c-ddf4840bbe98 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:47.897016 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ff33f731-ae3b-4af6-b33c-ddf4840bbe98 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:47.897459 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ff33f731-ae3b-4af6-b33c-ddf4840bbe98 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:47.897873 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ff33f731-ae3b-4af6-b33c-ddf4840bbe98 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:48.028468 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ff33f731-ae3b-4af6-b33c-ddf4840bbe98 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:48.036596 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ff33f731-ae3b-4af6-b33c-ddf4840bbe98 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1365 microversion: 2.1 time: 0.151861 Sep 15 13:04:48.037161 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 272/549] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:47 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:04:49.058846 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e2925d31-5cbb-47fc-8dbf-4e453a2575b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:49.059459 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e2925d31-5cbb-47fc-8dbf-4e453a2575b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:49.066597 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e2925d31-5cbb-47fc-8dbf-4e453a2575b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:49.067076 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e2925d31-5cbb-47fc-8dbf-4e453a2575b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:49.067506 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e2925d31-5cbb-47fc-8dbf-4e453a2575b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:49.068187 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e2925d31-5cbb-47fc-8dbf-4e453a2575b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:49.068659 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e2925d31-5cbb-47fc-8dbf-4e453a2575b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:49.069077 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e2925d31-5cbb-47fc-8dbf-4e453a2575b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:49.201663 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e2925d31-5cbb-47fc-8dbf-4e453a2575b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:49.209348 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e2925d31-5cbb-47fc-8dbf-4e453a2575b9 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1365 microversion: 2.1 time: 0.154299 Sep 15 13:04:49.209913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 278/550] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:49 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:50.231632 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2002bc7c-f076-425d-8522-ab2ad53ccad3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:50.232239 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2002bc7c-f076-425d-8522-ab2ad53ccad3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:50.238549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2002bc7c-f076-425d-8522-ab2ad53ccad3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:50.239020 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2002bc7c-f076-425d-8522-ab2ad53ccad3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:50.239453 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2002bc7c-f076-425d-8522-ab2ad53ccad3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:50.240128 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2002bc7c-f076-425d-8522-ab2ad53ccad3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:50.240606 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2002bc7c-f076-425d-8522-ab2ad53ccad3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:50.241020 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2002bc7c-f076-425d-8522-ab2ad53ccad3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:50.371053 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2002bc7c-f076-425d-8522-ab2ad53ccad3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:50.379263 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2002bc7c-f076-425d-8522-ab2ad53ccad3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1365 microversion: 2.1 time: 0.151552 Sep 15 13:04:50.379824 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 273/551] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:50 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:51.314109 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-737096e6-5f06-4cdf-ab1a-cb5e9ff96dce req-1c326b7e-0a28-44d7-9231-c9208d5b6a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28efcba-b6d3-4758-b3ea-de3992bc888a", "name": "network-vif-plugged", "status": "completed", "tag": "a943f44d-916a-4082-948c-693f4078378e"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:04:51.323923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-737096e6-5f06-4cdf-ab1a-cb5e9ff96dce req-1c326b7e-0a28-44d7-9231-c9208d5b6a18 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:51.323923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-737096e6-5f06-4cdf-ab1a-cb5e9ff96dce req-1c326b7e-0a28-44d7-9231-c9208d5b6a18 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:51.324379 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-737096e6-5f06-4cdf-ab1a-cb5e9ff96dce req-1c326b7e-0a28-44d7-9231-c9208d5b6a18 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:51.335983 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-737096e6-5f06-4cdf-ab1a-cb5e9ff96dce req-1c326b7e-0a28-44d7-9231-c9208d5b6a18 service nova] Creating event network-vif-plugged:a943f44d-916a-4082-948c-693f4078378e for instance d28efcba-b6d3-4758-b3ea-de3992bc888a on hv-cinder-83608 Sep 15 13:04:51.340836 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-737096e6-5f06-4cdf-ab1a-cb5e9ff96dce req-1c326b7e-0a28-44d7-9231-c9208d5b6a18 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087455 Sep 15 13:04:51.341430 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 279/552] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:04:51.401664 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-10e1b273-dbab-4cf4-bdb6-85e3fb602c17 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:51.402291 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-10e1b273-dbab-4cf4-bdb6-85e3fb602c17 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:51.408444 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-10e1b273-dbab-4cf4-bdb6-85e3fb602c17 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:51.409007 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-10e1b273-dbab-4cf4-bdb6-85e3fb602c17 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:51.409509 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-10e1b273-dbab-4cf4-bdb6-85e3fb602c17 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:51.410269 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-10e1b273-dbab-4cf4-bdb6-85e3fb602c17 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:51.410807 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-10e1b273-dbab-4cf4-bdb6-85e3fb602c17 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:51.411294 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-10e1b273-dbab-4cf4-bdb6-85e3fb602c17 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:51.547044 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-10e1b273-dbab-4cf4-bdb6-85e3fb602c17 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:51.555176 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-10e1b273-dbab-4cf4-bdb6-85e3fb602c17 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1365 microversion: 2.1 time: 0.157411 Sep 15 13:04:51.555855 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 274/553] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:51 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:52.575883 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:52.576710 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=6 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:52.581291 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a509a9bc-eba3-4138-ab9c-e6523f625182 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:52.581997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a509a9bc-eba3-4138-ab9c-e6523f625182 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:52.589040 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a509a9bc-eba3-4138-ab9c-e6523f625182 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:52.589521 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a509a9bc-eba3-4138-ab9c-e6523f625182 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:52.589957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a509a9bc-eba3-4138-ab9c-e6523f625182 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:52.590646 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a509a9bc-eba3-4138-ab9c-e6523f625182 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:52.591100 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a509a9bc-eba3-4138-ab9c-e6523f625182 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:52.591528 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a509a9bc-eba3-4138-ab9c-e6523f625182 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:52.612831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:52.727422 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a509a9bc-eba3-4138-ab9c-e6523f625182 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:52.735688 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a509a9bc-eba3-4138-ab9c-e6523f625182 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1365 microversion: 2.1 time: 0.160809 Sep 15 13:04:52.736260 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 280/554] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:52 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:53.758836 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8c4d1d0e-6f10-4183-9865-b7fe898a3e25 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:53.759408 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8c4d1d0e-6f10-4183-9865-b7fe898a3e25 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:53.761372 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=6 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:53.767792 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8c4d1d0e-6f10-4183-9865-b7fe898a3e25 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:53.768293 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8c4d1d0e-6f10-4183-9865-b7fe898a3e25 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:53.768726 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8c4d1d0e-6f10-4183-9865-b7fe898a3e25 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:53.769669 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8c4d1d0e-6f10-4183-9865-b7fe898a3e25 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:53.770121 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8c4d1d0e-6f10-4183-9865-b7fe898a3e25 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:53.770541 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8c4d1d0e-6f10-4183-9865-b7fe898a3e25 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:53.897796 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8c4d1d0e-6f10-4183-9865-b7fe898a3e25 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:53.906119 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8c4d1d0e-6f10-4183-9865-b7fe898a3e25 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1555 microversion: 2.1 time: 0.150459 Sep 15 13:04:53.906723 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 275/555] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:04:53 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:53.928587 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bac13c0d-73e6-4dc4-95a1-b6632a50b643 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:53.929086 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-bac13c0d-73e6-4dc4-95a1-b6632a50b643 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:53.935322 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bac13c0d-73e6-4dc4-95a1-b6632a50b643 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:53.935797 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bac13c0d-73e6-4dc4-95a1-b6632a50b643 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:53.936227 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bac13c0d-73e6-4dc4-95a1-b6632a50b643 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:53.937337 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bac13c0d-73e6-4dc4-95a1-b6632a50b643 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:53.937790 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bac13c0d-73e6-4dc4-95a1-b6632a50b643 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:53.938208 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bac13c0d-73e6-4dc4-95a1-b6632a50b643 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:54.014217 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-bac13c0d-73e6-4dc4-95a1-b6632a50b643 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089378 Sep 15 13:04:54.015380 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 281/556] 10.222.0.57 () {58 vars in 1275 bytes} [Thu Sep 15 13:04:53 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:04:55.179581 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-2dcf2334-6920-4ab9-b342-ab9f147df183 req-17b7d95a-0524-4f60-a6a6-b3bb11b14e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28efcba-b6d3-4758-b3ea-de3992bc888a", "tag": "a943f44d-916a-4082-948c-693f4078378e"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:04:55.190084 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-2dcf2334-6920-4ab9-b342-ab9f147df183 req-17b7d95a-0524-4f60-a6a6-b3bb11b14e60 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:55.190556 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-2dcf2334-6920-4ab9-b342-ab9f147df183 req-17b7d95a-0524-4f60-a6a6-b3bb11b14e60 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:55.190977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-2dcf2334-6920-4ab9-b342-ab9f147df183 req-17b7d95a-0524-4f60-a6a6-b3bb11b14e60 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:55.202098 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-2dcf2334-6920-4ab9-b342-ab9f147df183 req-17b7d95a-0524-4f60-a6a6-b3bb11b14e60 service nova] Creating event network-changed:a943f44d-916a-4082-948c-693f4078378e for instance d28efcba-b6d3-4758-b3ea-de3992bc888a on hv-cinder-83608 Sep 15 13:04:55.207199 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-2dcf2334-6920-4ab9-b342-ab9f147df183 req-17b7d95a-0524-4f60-a6a6-b3bb11b14e60 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085907 Sep 15 13:04:55.207803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 276/557] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:04:57.788507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-db460570-95dd-4577-8b4f-b27e112db749 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:57.789000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-db460570-95dd-4577-8b4f-b27e112db749 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:57.795038 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db460570-95dd-4577-8b4f-b27e112db749 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:57.795660 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db460570-95dd-4577-8b4f-b27e112db749 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:57.796684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db460570-95dd-4577-8b4f-b27e112db749 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:57.797387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db460570-95dd-4577-8b4f-b27e112db749 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:57.797845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db460570-95dd-4577-8b4f-b27e112db749 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:57.798271 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db460570-95dd-4577-8b4f-b27e112db749 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:57.828196 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-db460570-95dd-4577-8b4f-b27e112db749 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/os-volume_attachments/d4327263-b709-486a-b876-9c91b8ff87e8" status: 200 len: 194 microversion: 2.20 time: 0.044092 Sep 15 13:04:57.828803 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 282/558] 10.222.0.57 () {60 vars in 1454 bytes} [Thu Sep 15 13:04:57 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/os-volume_attachments/d4327263-b709-486a-b876-9c91b8ff87e8 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 13:04:57.898321 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b94ed8f9-c348-48ad-aeaf-c4541c70b80c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:57.898886 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b94ed8f9-c348-48ad-aeaf-c4541c70b80c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:57.905758 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b94ed8f9-c348-48ad-aeaf-c4541c70b80c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:57.906262 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b94ed8f9-c348-48ad-aeaf-c4541c70b80c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:57.906694 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b94ed8f9-c348-48ad-aeaf-c4541c70b80c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:57.907387 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b94ed8f9-c348-48ad-aeaf-c4541c70b80c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:57.907865 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b94ed8f9-c348-48ad-aeaf-c4541c70b80c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:57.908301 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b94ed8f9-c348-48ad-aeaf-c4541c70b80c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:58.033481 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-b94ed8f9-c348-48ad-aeaf-c4541c70b80c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lazy-loading 'services' on Instance uuid 1777381a-01af-43ba-98dc-31bfeeded7bb {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:04:58.135006 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:58.146221 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b94ed8f9-c348-48ad-aeaf-c4541c70b80c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/os-volume_attachments/d4327263-b709-486a-b876-9c91b8ff87e8" status: 202 len: 0 microversion: 2.20 time: 0.252483 Sep 15 13:04:58.146800 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 277/559] 10.222.0.57 () {60 vars in 1457 bytes} [Thu Sep 15 13:04:57 2022] DELETE /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/os-volume_attachments/d4327263-b709-486a-b876-9c91b8ff87e8 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:04:58.155636 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b778537f-462c-42f7-a908-a9e691ea9fab tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:58.157906 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b778537f-462c-42f7-a908-a9e691ea9fab tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:58.168473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b778537f-462c-42f7-a908-a9e691ea9fab tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:58.168972 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b778537f-462c-42f7-a908-a9e691ea9fab tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:58.169416 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b778537f-462c-42f7-a908-a9e691ea9fab tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:58.170232 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b778537f-462c-42f7-a908-a9e691ea9fab tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:58.171558 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b778537f-462c-42f7-a908-a9e691ea9fab tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:58.171983 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b778537f-462c-42f7-a908-a9e691ea9fab tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:58.202618 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b778537f-462c-42f7-a908-a9e691ea9fab tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050931 Sep 15 13:04:58.203183 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 283/560] 10.222.0.57 () {60 vars in 1343 bytes} [Thu Sep 15 13:04:58 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 13:04:59.216012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-158458b4-28cc-47c0-929a-5412a235660d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:59.219904 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-158458b4-28cc-47c0-929a-5412a235660d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:59.226091 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-158458b4-28cc-47c0-929a-5412a235660d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:59.226573 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-158458b4-28cc-47c0-929a-5412a235660d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:59.227005 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-158458b4-28cc-47c0-929a-5412a235660d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:59.227686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-158458b4-28cc-47c0-929a-5412a235660d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:59.228135 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-158458b4-28cc-47c0-929a-5412a235660d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:59.228579 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-158458b4-28cc-47c0-929a-5412a235660d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:59.260978 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-158458b4-28cc-47c0-929a-5412a235660d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049626 Sep 15 13:04:59.261540 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 278/561] 10.222.0.57 () {60 vars in 1343 bytes} [Thu Sep 15 13:04:59 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:04:59.324714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f55a0fd4-edd4-46a1-97aa-b04e24e5d1a9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:59.325218 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f55a0fd4-edd4-46a1-97aa-b04e24e5d1a9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:59.331578 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f55a0fd4-edd4-46a1-97aa-b04e24e5d1a9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:59.332063 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f55a0fd4-edd4-46a1-97aa-b04e24e5d1a9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:59.332540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f55a0fd4-edd4-46a1-97aa-b04e24e5d1a9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:59.333229 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f55a0fd4-edd4-46a1-97aa-b04e24e5d1a9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:59.333682 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f55a0fd4-edd4-46a1-97aa-b04e24e5d1a9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:59.334106 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f55a0fd4-edd4-46a1-97aa-b04e24e5d1a9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:59.359636 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f55a0fd4-edd4-46a1-97aa-b04e24e5d1a9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Going to try to terminate instance {{(pid=120633) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:04:59.431683 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f55a0fd4-edd4-46a1-97aa-b04e24e5d1a9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 204 len: 0 microversion: 2.20 time: 0.110479 Sep 15 13:04:59.432254 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 284/562] 10.222.0.57 () {60 vars in 1280 bytes} [Thu Sep 15 13:04:59 2022] DELETE /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 13:04:59.441209 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-85bc3159-c03b-4f20-b97a-d5e2d4791178 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:04:59.441818 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-85bc3159-c03b-4f20-b97a-d5e2d4791178 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:04:59.447710 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-85bc3159-c03b-4f20-b97a-d5e2d4791178 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:59.448194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-85bc3159-c03b-4f20-b97a-d5e2d4791178 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:59.448668 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-85bc3159-c03b-4f20-b97a-d5e2d4791178 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:59.449357 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-85bc3159-c03b-4f20-b97a-d5e2d4791178 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:04:59.449813 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-85bc3159-c03b-4f20-b97a-d5e2d4791178 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:04:59.450238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-85bc3159-c03b-4f20-b97a-d5e2d4791178 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:04:59.583755 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-85bc3159-c03b-4f20-b97a-d5e2d4791178 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:59.591817 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-85bc3159-c03b-4f20-b97a-d5e2d4791178 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:59.593608 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-85bc3159-c03b-4f20-b97a-d5e2d4791178 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:04:59.594751 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-85bc3159-c03b-4f20-b97a-d5e2d4791178 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1724 microversion: 2.20 time: 0.157385 Sep 15 13:04:59.595428 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 279/563] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:04:59 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:05:00.620664 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9cfcdd0d-ecd1-4bab-a513-1cffbdb4757b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:00.621362 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9cfcdd0d-ecd1-4bab-a513-1cffbdb4757b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:00.623781 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:00.629252 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9cfcdd0d-ecd1-4bab-a513-1cffbdb4757b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:00.629735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9cfcdd0d-ecd1-4bab-a513-1cffbdb4757b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:00.630168 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9cfcdd0d-ecd1-4bab-a513-1cffbdb4757b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:00.630856 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9cfcdd0d-ecd1-4bab-a513-1cffbdb4757b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:00.631305 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9cfcdd0d-ecd1-4bab-a513-1cffbdb4757b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:00.631727 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9cfcdd0d-ecd1-4bab-a513-1cffbdb4757b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:00.763761 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9cfcdd0d-ecd1-4bab-a513-1cffbdb4757b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:00.772619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9cfcdd0d-ecd1-4bab-a513-1cffbdb4757b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:00.774069 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9cfcdd0d-ecd1-4bab-a513-1cffbdb4757b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:00.775216 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9cfcdd0d-ecd1-4bab-a513-1cffbdb4757b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1724 microversion: 2.20 time: 0.158904 Sep 15 13:05:00.775771 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 285/564] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:00 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:01.802292 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-db06725f-d78f-4d23-839d-746df5625d3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:01.802931 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-db06725f-d78f-4d23-839d-746df5625d3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:01.804990 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:01.810056 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-db06725f-d78f-4d23-839d-746df5625d3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:01.810547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-db06725f-d78f-4d23-839d-746df5625d3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:01.810980 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-db06725f-d78f-4d23-839d-746df5625d3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:01.812492 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-db06725f-d78f-4d23-839d-746df5625d3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:01.813139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-db06725f-d78f-4d23-839d-746df5625d3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:01.813569 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-db06725f-d78f-4d23-839d-746df5625d3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:01.900144 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-db06725f-d78f-4d23-839d-746df5625d3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:01.909704 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-db06725f-d78f-4d23-839d-746df5625d3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:01.911416 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-db06725f-d78f-4d23-839d-746df5625d3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:01.912653 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-db06725f-d78f-4d23-839d-746df5625d3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1656 microversion: 2.20 time: 0.115457 Sep 15 13:05:01.913217 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 280/565] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:01 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1656 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:02.170936 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-c958cade-c8b9-476f-a0f0-6ac759d22337 req-bb5741cc-5bed-499b-b37c-43733ddf75e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1777381a-01af-43ba-98dc-31bfeeded7bb", "name": "network-vif-deleted", "tag": "12b0a8a8-4a84-4e3e-8e96-e6939fe11e18"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:02.182284 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-c958cade-c8b9-476f-a0f0-6ac759d22337 req-bb5741cc-5bed-499b-b37c-43733ddf75e5 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:02.182690 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-c958cade-c8b9-476f-a0f0-6ac759d22337 req-bb5741cc-5bed-499b-b37c-43733ddf75e5 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:02.183117 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-c958cade-c8b9-476f-a0f0-6ac759d22337 req-bb5741cc-5bed-499b-b37c-43733ddf75e5 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:02.195973 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-c958cade-c8b9-476f-a0f0-6ac759d22337 req-bb5741cc-5bed-499b-b37c-43733ddf75e5 service nova] Creating event network-vif-deleted:12b0a8a8-4a84-4e3e-8e96-e6939fe11e18 for instance 1777381a-01af-43ba-98dc-31bfeeded7bb on hv-cinder-83608 Sep 15 13:05:02.201499 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-c958cade-c8b9-476f-a0f0-6ac759d22337 req-bb5741cc-5bed-499b-b37c-43733ddf75e5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034504 Sep 15 13:05:02.202994 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 286/566] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:05:02.941900 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:02.942718 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:02.949084 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:02.949701 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:02.950227 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:02.951147 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:02.951683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:02.952261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:02.986734 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:02.987220 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:02.987650 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:02.988093 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lazy-loading 'fault' on Instance uuid 1777381a-01af-43ba-98dc-31bfeeded7bb {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:05:03.031677 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:03.040149 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:03.041662 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:03.042826 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ac1bf3c8-07ca-4323-b721-a377e1bb624c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 200 len: 1371 microversion: 2.20 time: 0.107662 Sep 15 13:05:03.043399 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 281/567] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:02 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:04.070883 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-41ee6bfb-2c5d-4bc4-b3bc-f68748c9a7a0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:04.071579 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-41ee6bfb-2c5d-4bc4-b3bc-f68748c9a7a0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:04.078474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-41ee6bfb-2c5d-4bc4-b3bc-f68748c9a7a0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:04.078955 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-41ee6bfb-2c5d-4bc4-b3bc-f68748c9a7a0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:04.079383 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-41ee6bfb-2c5d-4bc4-b3bc-f68748c9a7a0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:04.080090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-41ee6bfb-2c5d-4bc4-b3bc-f68748c9a7a0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:04.081019 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-41ee6bfb-2c5d-4bc4-b3bc-f68748c9a7a0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:04.081443 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-41ee6bfb-2c5d-4bc4-b3bc-f68748c9a7a0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:04.096556 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-41ee6bfb-2c5d-4bc4-b3bc-f68748c9a7a0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] HTTP exception thrown: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-41ee6bfb-2c5d-4bc4-b3bc-f68748c9a7a0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Request method failure captured: Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb HTTP/1.1 Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyGGYRzHJ05hjHYgSTJM4m5vV4OGNuAzzTXy_b-nXNy4za0VZ8ff_XnOR0L6DEJjE1uvsP_b-yP7TJQWb3u16zemup6MPJKsdmr4ohzSITEb3JhwPOPdIbb5HINoAcXD1WmYgGLyGu3akKmPCYsqX6rCuqs4srW6XGS_xle_PrdIt3o Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 6180da28285943f7a7b0900185df6127 Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:05:04.098199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:05:04.099831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6180da28285943f7a7b0900185df6127", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6180da28285943f7a7b0900185df6127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6180da28285943f7a7b0900185df6127"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6180da28285943f7a7b0900185df6127"}]}] Sep 15 13:05:04.099831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:05:04.099831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 6180da28285943f7a7b0900185df6127 Sep 15 13:05:04.099831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:05:04.099831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeShelveTestJSON-2136858861-project Sep 15 13:05:04.099831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:05:04.099831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:05:04.099831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 2f0feb7134ee408b989b398a315850fe Sep 15 13:05:04.099831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2136858861-project Sep 15 13:05:04.099831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:05:04.099831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:05:04.099831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '1777381a-01af-43ba-98dc-31bfeeded7bb'} Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:05:04.100857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:05:04.102346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:04.103742 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-41ee6bfb-2c5d-4bc4-b3bc-f68748c9a7a0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Returning 404 to user: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:05:04.103742 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-41ee6bfb-2c5d-4bc4-b3bc-f68748c9a7a0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 404 len: 111 microversion: 2.20 time: 0.033748 Sep 15 13:05:04.103742 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 287/568] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:04 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 13:05:04.108575 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d1e75258-2253-409f-adef-926a5e772982 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '.version_select at 0x7f62c55c68b0>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:04.129737 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d1e75258-2253-409f-adef-926a5e772982 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098287462" status: 204 len: 0 microversion: 2.20 time: 0.024920 Sep 15 13:05:04.130315 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 282/569] 10.222.0.57 () {60 vars in 1262 bytes} [Thu Sep 15 13:05:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098287462 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 13:05:04.744453 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-056116c8-60b6-4255-984b-95a368609f3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Action: 'create', calling method: .version_select at 0x7f62c552bd30>, body: {"keypair": {"name": "tempest-keypair-1125845498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXiFERdSAntc+yfPrG4AlpU7gSVB/fAcNj9MXQv4nW8anJWve2BB/y7UHXkiOi144/1/e3EttX9VJeIsKY8EDGUb/M+WYSVW0DlHvAcnvSBAyA+iKg+PKqIjEbL2GtrNg=="}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:04.759654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-056116c8-60b6-4255-984b-95a368609f3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Getting quotas for project 6180da28285943f7a7b0900185df6127. Resources: {'key_pairs'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:05:04.763572 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-056116c8-60b6-4255-984b-95a368609f3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Getting quotas for user 2f0feb7134ee408b989b398a315850fe and project 6180da28285943f7a7b0900185df6127. Resources: {'key_pairs'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:05:04.786138 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-056116c8-60b6-4255-984b-95a368609f3f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045591 Sep 15 13:05:04.786727 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 288/570] 10.222.0.57 () {62 vars in 1200 bytes} [Thu Sep 15 13:05:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 15 13:05:05.991189 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1392463331", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47875655-3272-49b9-a3bb-38bf6ec7a8c6"}], "security_groups": [{"name": "tempest-securitygroup--1072284208"}], "key_name": "tempest-keypair-1125845498", "user_data": "}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:06.093785 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.network.neutron [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] validate_networks() for [('47875655-3272-49b9-a3bb-38bf6ec7a8c6', None, None, None, None, None)] {{(pid=120634) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:05:06.504990 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Flavor limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:05:06.505593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Image limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:05:06.506060 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Flavor pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:05:06.506460 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Image pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:05:06.506893 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:05:06.515626 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:06.516097 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:06.516559 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:06.517277 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:06.517725 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:06.518142 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:06.535050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Getting quotas for project 6180da28285943f7a7b0900185df6127. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:05:06.538909 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Getting quotas for user 2f0feb7134ee408b989b398a315850fe and project 6180da28285943f7a7b0900185df6127. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:05:06.550397 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Going to run 1 instances... {{(pid=120634) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:05:06.552652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120634) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:05:06.598718 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [9e8e7d8c-bcd5-4c9a-beb0-7b02ef84093e] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 13:05:07.605644 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO oslo.messaging._drivers.impl_rabbit [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [9e8e7d8c-bcd5-4c9a-beb0-7b02ef84093e] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 43454. Sep 15 13:05:07.609591 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a9aa72e0-d1c5-499a-b8b1-0f0eb2a710bf tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.622853 Sep 15 13:05:07.610283 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 283/571] 10.222.0.57 () {62 vars in 1188 bytes} [Thu Sep 15 13:05:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 15 13:05:07.621735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7a3e118d-5f6a-4e67-9c39-3e46a31ab74a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:07.622365 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7a3e118d-5f6a-4e67-9c39-3e46a31ab74a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:07.677330 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7a3e118d-5f6a-4e67-9c39-3e46a31ab74a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:07.684705 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7a3e118d-5f6a-4e67-9c39-3e46a31ab74a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:07.686682 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7a3e118d-5f6a-4e67-9c39-3e46a31ab74a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:07.687802 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7a3e118d-5f6a-4e67-9c39-3e46a31ab74a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1282 microversion: 2.20 time: 0.070487 Sep 15 13:05:07.688382 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 289/572] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:07 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:08.713249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-476f75cd-b1ea-4e62-9ab2-4d2632dc0565 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:08.713868 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-476f75cd-b1ea-4e62-9ab2-4d2632dc0565 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:08.720051 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-476f75cd-b1ea-4e62-9ab2-4d2632dc0565 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:08.720567 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-476f75cd-b1ea-4e62-9ab2-4d2632dc0565 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:08.721009 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-476f75cd-b1ea-4e62-9ab2-4d2632dc0565 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:08.721721 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-476f75cd-b1ea-4e62-9ab2-4d2632dc0565 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:08.722175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-476f75cd-b1ea-4e62-9ab2-4d2632dc0565 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:08.722602 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-476f75cd-b1ea-4e62-9ab2-4d2632dc0565 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:08.786108 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-476f75cd-b1ea-4e62-9ab2-4d2632dc0565 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:08.794175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-476f75cd-b1ea-4e62-9ab2-4d2632dc0565 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:08.796148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-476f75cd-b1ea-4e62-9ab2-4d2632dc0565 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:08.797283 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-476f75cd-b1ea-4e62-9ab2-4d2632dc0565 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1334 microversion: 2.20 time: 0.088001 Sep 15 13:05:08.797839 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 284/573] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:08 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:09.823965 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8e925b12-d7e7-4fe4-8757-1c25e89f5e42 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:09.824801 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-8e925b12-d7e7-4fe4-8757-1c25e89f5e42 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:09.831509 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8e925b12-d7e7-4fe4-8757-1c25e89f5e42 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:09.831991 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8e925b12-d7e7-4fe4-8757-1c25e89f5e42 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:09.832455 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8e925b12-d7e7-4fe4-8757-1c25e89f5e42 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:09.833153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8e925b12-d7e7-4fe4-8757-1c25e89f5e42 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:09.833602 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8e925b12-d7e7-4fe4-8757-1c25e89f5e42 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:09.834023 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8e925b12-d7e7-4fe4-8757-1c25e89f5e42 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:09.981342 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-8e925b12-d7e7-4fe4-8757-1c25e89f5e42 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:09.990902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-8e925b12-d7e7-4fe4-8757-1c25e89f5e42 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:09.992668 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-8e925b12-d7e7-4fe4-8757-1c25e89f5e42 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:09.993854 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8e925b12-d7e7-4fe4-8757-1c25e89f5e42 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1408 microversion: 2.20 time: 0.174098 Sep 15 13:05:09.994410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 290/574] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:09 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:10.616313 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-5a0fe137-841b-47f9-b8c4-762bc069c3f9 req-5361c3f5-c094-4d14-8f2b-d7a6ab09b0af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f141686-0b27-4fd1-9e23-6634ade717ae", "tag": "2e211122-d0c5-4c5f-9b31-8e606a42abd5"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:10.626214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-5a0fe137-841b-47f9-b8c4-762bc069c3f9 req-5361c3f5-c094-4d14-8f2b-d7a6ab09b0af service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:10.626685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-5a0fe137-841b-47f9-b8c4-762bc069c3f9 req-5361c3f5-c094-4d14-8f2b-d7a6ab09b0af service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:10.627116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-5a0fe137-841b-47f9-b8c4-762bc069c3f9 req-5361c3f5-c094-4d14-8f2b-d7a6ab09b0af service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:10.648562 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-5a0fe137-841b-47f9-b8c4-762bc069c3f9 req-5361c3f5-c094-4d14-8f2b-d7a6ab09b0af service nova] Creating event network-changed:2e211122-d0c5-4c5f-9b31-8e606a42abd5 for instance 8f141686-0b27-4fd1-9e23-6634ade717ae on hv-cinder-83608 Sep 15 13:05:10.653350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-5a0fe137-841b-47f9-b8c4-762bc069c3f9 req-5361c3f5-c094-4d14-8f2b-d7a6ab09b0af service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041092 Sep 15 13:05:10.653950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 285/575] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:05:11.018621 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d67d0a24-e555-4d78-8ffc-5ca74633e7d3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:11.019229 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d67d0a24-e555-4d78-8ffc-5ca74633e7d3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:11.026130 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d67d0a24-e555-4d78-8ffc-5ca74633e7d3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:11.026706 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d67d0a24-e555-4d78-8ffc-5ca74633e7d3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:11.027146 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d67d0a24-e555-4d78-8ffc-5ca74633e7d3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:11.027848 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d67d0a24-e555-4d78-8ffc-5ca74633e7d3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:11.028338 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d67d0a24-e555-4d78-8ffc-5ca74633e7d3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:11.028764 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d67d0a24-e555-4d78-8ffc-5ca74633e7d3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:11.158763 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d67d0a24-e555-4d78-8ffc-5ca74633e7d3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:11.166878 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d67d0a24-e555-4d78-8ffc-5ca74633e7d3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:11.168363 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d67d0a24-e555-4d78-8ffc-5ca74633e7d3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:11.169463 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d67d0a24-e555-4d78-8ffc-5ca74633e7d3 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1408 microversion: 2.20 time: 0.154760 Sep 15 13:05:11.170019 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 291/576] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:11 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:12.195211 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-727f4d10-7a11-4370-89ff-1a818d888b58 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:12.195909 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-727f4d10-7a11-4370-89ff-1a818d888b58 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:12.202780 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-727f4d10-7a11-4370-89ff-1a818d888b58 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:12.203258 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-727f4d10-7a11-4370-89ff-1a818d888b58 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:12.203692 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-727f4d10-7a11-4370-89ff-1a818d888b58 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:12.204407 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-727f4d10-7a11-4370-89ff-1a818d888b58 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:12.204885 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-727f4d10-7a11-4370-89ff-1a818d888b58 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:12.205306 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-727f4d10-7a11-4370-89ff-1a818d888b58 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:12.335124 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-727f4d10-7a11-4370-89ff-1a818d888b58 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:12.343542 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-727f4d10-7a11-4370-89ff-1a818d888b58 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:12.345009 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-727f4d10-7a11-4370-89ff-1a818d888b58 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:12.346099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-727f4d10-7a11-4370-89ff-1a818d888b58 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1408 microversion: 2.20 time: 0.155195 Sep 15 13:05:12.346658 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 286/577] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:12 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:12.484237 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-dc7ed2b7-07b9-4afc-8288-dd0068ae69ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:12.484781 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-dc7ed2b7-07b9-4afc-8288-dd0068ae69ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:12.491101 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dc7ed2b7-07b9-4afc-8288-dd0068ae69ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:12.491585 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dc7ed2b7-07b9-4afc-8288-dd0068ae69ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:12.492021 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dc7ed2b7-07b9-4afc-8288-dd0068ae69ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:12.492745 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dc7ed2b7-07b9-4afc-8288-dd0068ae69ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:12.493204 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dc7ed2b7-07b9-4afc-8288-dd0068ae69ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:12.493633 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dc7ed2b7-07b9-4afc-8288-dd0068ae69ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:12.573853 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-dc7ed2b7-07b9-4afc-8288-dd0068ae69ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lazy-loading 'services' on Instance uuid f4ff8111-8ab2-4e8d-8278-f76f69b76196 {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:05:12.645195 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-dc7ed2b7-07b9-4afc-8288-dd0068ae69ae tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-volume_attachments/f6b1bc3d-8ba0-45c5-9292-912dcdaa1ef9" status: 202 len: 0 microversion: 2.1 time: 0.164865 Sep 15 13:05:12.645784 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 292/578] 10.222.0.57 () {58 vars in 1416 bytes} [Thu Sep 15 13:05:12 2022] DELETE /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-volume_attachments/f6b1bc3d-8ba0-45c5-9292-912dcdaa1ef9 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:05:12.654073 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-75730a24-2e32-40b2-92a2-3aee2236595e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:12.656557 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-75730a24-2e32-40b2-92a2-3aee2236595e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:12.662475 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-75730a24-2e32-40b2-92a2-3aee2236595e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:12.662958 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-75730a24-2e32-40b2-92a2-3aee2236595e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:12.663388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-75730a24-2e32-40b2-92a2-3aee2236595e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:12.664072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-75730a24-2e32-40b2-92a2-3aee2236595e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:12.664547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-75730a24-2e32-40b2-92a2-3aee2236595e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:12.664965 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-75730a24-2e32-40b2-92a2-3aee2236595e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:12.695389 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-75730a24-2e32-40b2-92a2-3aee2236595e tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045140 Sep 15 13:05:12.695869 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 287/579] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:05:12 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:05:13.372490 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7c366b70-9531-4a56-b5d3-27543b0efc1e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:13.373117 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7c366b70-9531-4a56-b5d3-27543b0efc1e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:13.379443 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7c366b70-9531-4a56-b5d3-27543b0efc1e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:13.379929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7c366b70-9531-4a56-b5d3-27543b0efc1e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:13.380393 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7c366b70-9531-4a56-b5d3-27543b0efc1e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:13.381086 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7c366b70-9531-4a56-b5d3-27543b0efc1e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:13.381542 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7c366b70-9531-4a56-b5d3-27543b0efc1e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:13.381972 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7c366b70-9531-4a56-b5d3-27543b0efc1e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:13.523619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7c366b70-9531-4a56-b5d3-27543b0efc1e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:13.531910 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7c366b70-9531-4a56-b5d3-27543b0efc1e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:13.533822 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7c366b70-9531-4a56-b5d3-27543b0efc1e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:13.534524 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7c366b70-9531-4a56-b5d3-27543b0efc1e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1408 microversion: 2.20 time: 0.166452 Sep 15 13:05:13.535387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 293/580] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:13 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:13.708084 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1a62f8f0-3484-4d96-9e54-6d3710aee5d3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:13.710212 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1a62f8f0-3484-4d96-9e54-6d3710aee5d3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:13.716096 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a62f8f0-3484-4d96-9e54-6d3710aee5d3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:13.716634 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a62f8f0-3484-4d96-9e54-6d3710aee5d3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:13.717060 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a62f8f0-3484-4d96-9e54-6d3710aee5d3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:13.717749 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a62f8f0-3484-4d96-9e54-6d3710aee5d3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:13.718335 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a62f8f0-3484-4d96-9e54-6d3710aee5d3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:13.719015 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a62f8f0-3484-4d96-9e54-6d3710aee5d3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:13.747435 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1a62f8f0-3484-4d96-9e54-6d3710aee5d3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043265 Sep 15 13:05:13.747971 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 288/581] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:05:13 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:05:14.560680 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-440166fb-5692-4824-88f3-06cd6b818b0f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:14.561199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-440166fb-5692-4824-88f3-06cd6b818b0f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:14.568244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-440166fb-5692-4824-88f3-06cd6b818b0f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:14.568748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-440166fb-5692-4824-88f3-06cd6b818b0f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:14.569173 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-440166fb-5692-4824-88f3-06cd6b818b0f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:14.569863 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-440166fb-5692-4824-88f3-06cd6b818b0f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:14.570303 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-440166fb-5692-4824-88f3-06cd6b818b0f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:14.570717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-440166fb-5692-4824-88f3-06cd6b818b0f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:14.696145 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-440166fb-5692-4824-88f3-06cd6b818b0f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:14.704772 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-440166fb-5692-4824-88f3-06cd6b818b0f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:14.706220 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-440166fb-5692-4824-88f3-06cd6b818b0f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:14.707317 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-440166fb-5692-4824-88f3-06cd6b818b0f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1408 microversion: 2.20 time: 0.150595 Sep 15 13:05:14.707879 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 294/582] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:14 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:14.760458 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-104fd0d5-6d55-477d-9a38-d0e6f87ed9a9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:14.762581 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-104fd0d5-6d55-477d-9a38-d0e6f87ed9a9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:14.769035 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-104fd0d5-6d55-477d-9a38-d0e6f87ed9a9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:14.769764 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-104fd0d5-6d55-477d-9a38-d0e6f87ed9a9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:14.770204 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-104fd0d5-6d55-477d-9a38-d0e6f87ed9a9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:14.770890 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-104fd0d5-6d55-477d-9a38-d0e6f87ed9a9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:14.771339 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-104fd0d5-6d55-477d-9a38-d0e6f87ed9a9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:14.771762 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-104fd0d5-6d55-477d-9a38-d0e6f87ed9a9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:14.800431 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-104fd0d5-6d55-477d-9a38-d0e6f87ed9a9 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043885 Sep 15 13:05:14.800980 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 289/583] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:05:14 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 13:05:14.883390 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5954bed7-4c30-46ab-b519-5127c87bbf08 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:14.883881 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-5954bed7-4c30-46ab-b519-5127c87bbf08 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:14.889769 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5954bed7-4c30-46ab-b519-5127c87bbf08 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:14.890774 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5954bed7-4c30-46ab-b519-5127c87bbf08 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:14.891199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5954bed7-4c30-46ab-b519-5127c87bbf08 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:14.891876 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5954bed7-4c30-46ab-b519-5127c87bbf08 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:14.892354 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5954bed7-4c30-46ab-b519-5127c87bbf08 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:14.892770 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5954bed7-4c30-46ab-b519-5127c87bbf08 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:14.919220 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-5954bed7-4c30-46ab-b519-5127c87bbf08 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Going to try to terminate instance {{(pid=120633) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:05:14.993413 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-5954bed7-4c30-46ab-b519-5127c87bbf08 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 204 len: 0 microversion: 2.1 time: 0.113444 Sep 15 13:05:14.994006 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 295/584] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:05:14 2022] DELETE /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:05:15.002921 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5090cb56-1393-45d3-9d5d-c08d17155bb3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:15.003618 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5090cb56-1393-45d3-9d5d-c08d17155bb3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:15.009591 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5090cb56-1393-45d3-9d5d-c08d17155bb3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:15.010068 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5090cb56-1393-45d3-9d5d-c08d17155bb3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:15.010503 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5090cb56-1393-45d3-9d5d-c08d17155bb3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:15.011187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5090cb56-1393-45d3-9d5d-c08d17155bb3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:15.011638 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5090cb56-1393-45d3-9d5d-c08d17155bb3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:15.012059 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5090cb56-1393-45d3-9d5d-c08d17155bb3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:15.142550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5090cb56-1393-45d3-9d5d-c08d17155bb3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:15.150408 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5090cb56-1393-45d3-9d5d-c08d17155bb3 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1689 microversion: 2.1 time: 0.151893 Sep 15 13:05:15.150965 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 290/585] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:14 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:15.733251 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-46da6d30-d603-48ac-8eac-7e3d6df7fe49 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:15.734778 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-46da6d30-d603-48ac-8eac-7e3d6df7fe49 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:15.741208 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46da6d30-d603-48ac-8eac-7e3d6df7fe49 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:15.741721 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46da6d30-d603-48ac-8eac-7e3d6df7fe49 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:15.742152 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46da6d30-d603-48ac-8eac-7e3d6df7fe49 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:15.742848 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46da6d30-d603-48ac-8eac-7e3d6df7fe49 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:15.743295 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46da6d30-d603-48ac-8eac-7e3d6df7fe49 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:15.743714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46da6d30-d603-48ac-8eac-7e3d6df7fe49 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:15.878612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-46da6d30-d603-48ac-8eac-7e3d6df7fe49 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:15.882252 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:15.888224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-46da6d30-d603-48ac-8eac-7e3d6df7fe49 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:15.890480 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-46da6d30-d603-48ac-8eac-7e3d6df7fe49 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:15.891598 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-46da6d30-d603-48ac-8eac-7e3d6df7fe49 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1408 microversion: 2.20 time: 0.162586 Sep 15 13:05:15.892151 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 296/586] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:15 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:16.173040 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c9184ebf-8edd-4839-a7f4-986538461354 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:16.173578 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c9184ebf-8edd-4839-a7f4-986538461354 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:16.179503 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c9184ebf-8edd-4839-a7f4-986538461354 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:16.179987 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c9184ebf-8edd-4839-a7f4-986538461354 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:16.180481 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c9184ebf-8edd-4839-a7f4-986538461354 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:16.181165 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c9184ebf-8edd-4839-a7f4-986538461354 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:16.181615 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c9184ebf-8edd-4839-a7f4-986538461354 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:16.182041 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c9184ebf-8edd-4839-a7f4-986538461354 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:16.312156 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c9184ebf-8edd-4839-a7f4-986538461354 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:16.320061 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c9184ebf-8edd-4839-a7f4-986538461354 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1689 microversion: 2.1 time: 0.151098 Sep 15 13:05:16.320673 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 291/587] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:16 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:16.917481 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-61fe9271-a749-4752-b600-9b1c282715e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:16.918100 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-61fe9271-a749-4752-b600-9b1c282715e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:16.925872 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61fe9271-a749-4752-b600-9b1c282715e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:16.926356 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61fe9271-a749-4752-b600-9b1c282715e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:16.926796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61fe9271-a749-4752-b600-9b1c282715e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:16.927496 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61fe9271-a749-4752-b600-9b1c282715e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:16.927954 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61fe9271-a749-4752-b600-9b1c282715e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:16.928414 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61fe9271-a749-4752-b600-9b1c282715e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:17.055010 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-61fe9271-a749-4752-b600-9b1c282715e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:17.063182 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-61fe9271-a749-4752-b600-9b1c282715e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:17.064712 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-61fe9271-a749-4752-b600-9b1c282715e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:17.065817 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-61fe9271-a749-4752-b600-9b1c282715e0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1408 microversion: 2.20 time: 0.152297 Sep 15 13:05:17.066379 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 297/588] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:16 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:17.343354 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8c02e521-d630-47be-8701-dea2b0c0e655 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:17.344199 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8c02e521-d630-47be-8701-dea2b0c0e655 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:17.346010 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:17.346667 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=6 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:17.352701 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8c02e521-d630-47be-8701-dea2b0c0e655 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:17.353187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8c02e521-d630-47be-8701-dea2b0c0e655 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:17.353644 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8c02e521-d630-47be-8701-dea2b0c0e655 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:17.354344 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8c02e521-d630-47be-8701-dea2b0c0e655 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:17.354829 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8c02e521-d630-47be-8701-dea2b0c0e655 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:17.355250 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8c02e521-d630-47be-8701-dea2b0c0e655 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:17.429563 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-795177e6-52be-4f7c-8dd8-5d8ab03ffe30 req-99455ba0-6c74-45cc-90cc-4038309f508e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f141686-0b27-4fd1-9e23-6634ade717ae", "name": "network-vif-plugged", "status": "completed", "tag": "2e211122-d0c5-4c5f-9b31-8e606a42abd5"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:17.441142 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-795177e6-52be-4f7c-8dd8-5d8ab03ffe30 req-99455ba0-6c74-45cc-90cc-4038309f508e service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:17.442293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-795177e6-52be-4f7c-8dd8-5d8ab03ffe30 req-99455ba0-6c74-45cc-90cc-4038309f508e service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:17.442733 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-795177e6-52be-4f7c-8dd8-5d8ab03ffe30 req-99455ba0-6c74-45cc-90cc-4038309f508e service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:17.454984 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-795177e6-52be-4f7c-8dd8-5d8ab03ffe30 req-99455ba0-6c74-45cc-90cc-4038309f508e service nova] Creating event network-vif-plugged:2e211122-d0c5-4c5f-9b31-8e606a42abd5 for instance 8f141686-0b27-4fd1-9e23-6634ade717ae on hv-cinder-83608 Sep 15 13:05:17.460433 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-795177e6-52be-4f7c-8dd8-5d8ab03ffe30 req-99455ba0-6c74-45cc-90cc-4038309f508e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033986 Sep 15 13:05:17.460855 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 298/589] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:05:17.493625 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8c02e521-d630-47be-8701-dea2b0c0e655 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:17.502750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8c02e521-d630-47be-8701-dea2b0c0e655 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1689 microversion: 2.1 time: 0.163516 Sep 15 13:05:17.503337 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 292/590] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:17 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:18.091531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a7f8a93a-cc6a-489c-b7b8-74d49810ea8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:18.092187 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a7f8a93a-cc6a-489c-b7b8-74d49810ea8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:18.094984 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=6 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:18.101534 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a7f8a93a-cc6a-489c-b7b8-74d49810ea8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:18.102030 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a7f8a93a-cc6a-489c-b7b8-74d49810ea8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:18.102472 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a7f8a93a-cc6a-489c-b7b8-74d49810ea8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:18.103182 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a7f8a93a-cc6a-489c-b7b8-74d49810ea8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:18.103666 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a7f8a93a-cc6a-489c-b7b8-74d49810ea8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:18.104095 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a7f8a93a-cc6a-489c-b7b8-74d49810ea8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:18.234168 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a7f8a93a-cc6a-489c-b7b8-74d49810ea8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:18.242670 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a7f8a93a-cc6a-489c-b7b8-74d49810ea8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:18.244111 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a7f8a93a-cc6a-489c-b7b8-74d49810ea8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:18.245234 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a7f8a93a-cc6a-489c-b7b8-74d49810ea8a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1408 microversion: 2.20 time: 0.158028 Sep 15 13:05:18.245791 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 299/591] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:18 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:18.526494 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-7c367741-e3a0-4e23-ba50-1ce34ca73aa5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:18.527377 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-7c367741-e3a0-4e23-ba50-1ce34ca73aa5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:18.533722 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c367741-e3a0-4e23-ba50-1ce34ca73aa5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:18.534219 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c367741-e3a0-4e23-ba50-1ce34ca73aa5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:18.534652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c367741-e3a0-4e23-ba50-1ce34ca73aa5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:18.535360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c367741-e3a0-4e23-ba50-1ce34ca73aa5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:18.535919 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c367741-e3a0-4e23-ba50-1ce34ca73aa5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:18.536367 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c367741-e3a0-4e23-ba50-1ce34ca73aa5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:18.730027 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-7c367741-e3a0-4e23-ba50-1ce34ca73aa5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:18.738455 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-7c367741-e3a0-4e23-ba50-1ce34ca73aa5 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1689 microversion: 2.1 time: 0.215789 Sep 15 13:05:18.739027 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 293/592] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:18 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1689 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:19.271501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4950c866-68b4-414c-afa0-d5d99c6ce4e6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:19.272022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-4950c866-68b4-414c-afa0-d5d99c6ce4e6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:19.278432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4950c866-68b4-414c-afa0-d5d99c6ce4e6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:19.278913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4950c866-68b4-414c-afa0-d5d99c6ce4e6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:19.279346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4950c866-68b4-414c-afa0-d5d99c6ce4e6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:19.280039 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4950c866-68b4-414c-afa0-d5d99c6ce4e6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:19.280519 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4950c866-68b4-414c-afa0-d5d99c6ce4e6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:19.281549 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4950c866-68b4-414c-afa0-d5d99c6ce4e6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:19.411873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4950c866-68b4-414c-afa0-d5d99c6ce4e6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:19.419933 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4950c866-68b4-414c-afa0-d5d99c6ce4e6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:19.421431 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4950c866-68b4-414c-afa0-d5d99c6ce4e6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:19.422519 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-4950c866-68b4-414c-afa0-d5d99c6ce4e6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1408 microversion: 2.20 time: 0.155308 Sep 15 13:05:19.423103 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 300/593] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:19 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:19.762193 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-500db052-cc99-44bb-a722-2d5387f0a872 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:19.762810 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-500db052-cc99-44bb-a722-2d5387f0a872 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:19.769461 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-500db052-cc99-44bb-a722-2d5387f0a872 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:19.770201 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-500db052-cc99-44bb-a722-2d5387f0a872 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:19.770639 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-500db052-cc99-44bb-a722-2d5387f0a872 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:19.771330 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-500db052-cc99-44bb-a722-2d5387f0a872 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:19.771785 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-500db052-cc99-44bb-a722-2d5387f0a872 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:19.772208 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-500db052-cc99-44bb-a722-2d5387f0a872 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:19.899883 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-500db052-cc99-44bb-a722-2d5387f0a872 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:19.907664 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-500db052-cc99-44bb-a722-2d5387f0a872 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1689 microversion: 2.1 time: 0.149397 Sep 15 13:05:19.908228 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 294/594] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:19 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:20.447388 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5460b0e0-bdf3-43f4-b7f6-21f589cdcd2b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:20.448653 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-5460b0e0-bdf3-43f4-b7f6-21f589cdcd2b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:20.456061 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5460b0e0-bdf3-43f4-b7f6-21f589cdcd2b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:20.456582 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5460b0e0-bdf3-43f4-b7f6-21f589cdcd2b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:20.457058 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5460b0e0-bdf3-43f4-b7f6-21f589cdcd2b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:20.457755 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5460b0e0-bdf3-43f4-b7f6-21f589cdcd2b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:20.458402 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5460b0e0-bdf3-43f4-b7f6-21f589cdcd2b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:20.458629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5460b0e0-bdf3-43f4-b7f6-21f589cdcd2b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:20.597679 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-5460b0e0-bdf3-43f4-b7f6-21f589cdcd2b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:20.606041 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-5460b0e0-bdf3-43f4-b7f6-21f589cdcd2b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:20.607559 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-5460b0e0-bdf3-43f4-b7f6-21f589cdcd2b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:20.608749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-5460b0e0-bdf3-43f4-b7f6-21f589cdcd2b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1601 microversion: 2.20 time: 0.165638 Sep 15 13:05:20.609460 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 301/595] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:05:20 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:05:20.633517 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-25714d62-125a-4b64-a8c8-5245be33302f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:20.634392 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-25714d62-125a-4b64-a8c8-5245be33302f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:20.641182 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-25714d62-125a-4b64-a8c8-5245be33302f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:20.641784 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-25714d62-125a-4b64-a8c8-5245be33302f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:20.642222 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-25714d62-125a-4b64-a8c8-5245be33302f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:20.643115 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-25714d62-125a-4b64-a8c8-5245be33302f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:20.643576 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-25714d62-125a-4b64-a8c8-5245be33302f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:20.644004 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-25714d62-125a-4b64-a8c8-5245be33302f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:20.754013 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-25714d62-125a-4b64-a8c8-5245be33302f tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.124381 Sep 15 13:05:20.754789 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 295/596] 10.222.0.57 () {60 vars in 1316 bytes} [Thu Sep 15 13:05:20 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 13:05:20.804568 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-add627a3-7043-430e-aafa-72ac8c510f3e req-ddafc2a2-a8e3-4d86-bcc9-40d8bd0ecf58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4ff8111-8ab2-4e8d-8278-f76f69b76196", "name": "network-vif-deleted", "tag": "de279c4f-9053-44d1-aa49-aa402574c2ed"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:20.816858 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-add627a3-7043-430e-aafa-72ac8c510f3e req-ddafc2a2-a8e3-4d86-bcc9-40d8bd0ecf58 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:20.817461 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-add627a3-7043-430e-aafa-72ac8c510f3e req-ddafc2a2-a8e3-4d86-bcc9-40d8bd0ecf58 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:20.817758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-add627a3-7043-430e-aafa-72ac8c510f3e req-ddafc2a2-a8e3-4d86-bcc9-40d8bd0ecf58 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:20.831339 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-add627a3-7043-430e-aafa-72ac8c510f3e req-ddafc2a2-a8e3-4d86-bcc9-40d8bd0ecf58 service nova] Creating event network-vif-deleted:de279c4f-9053-44d1-aa49-aa402574c2ed for instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 on hv-cinder-83608 Sep 15 13:05:20.836576 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-add627a3-7043-430e-aafa-72ac8c510f3e req-ddafc2a2-a8e3-4d86-bcc9-40d8bd0ecf58 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036367 Sep 15 13:05:20.840259 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 302/597] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:05:20.931010 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d34ad4c6-4489-4569-916c-db4baa7df110 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:20.931743 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d34ad4c6-4489-4569-916c-db4baa7df110 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:20.945888 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d34ad4c6-4489-4569-916c-db4baa7df110 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:20.948813 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d34ad4c6-4489-4569-916c-db4baa7df110 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:20.949540 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d34ad4c6-4489-4569-916c-db4baa7df110 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:20.950472 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d34ad4c6-4489-4569-916c-db4baa7df110 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:20.951098 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d34ad4c6-4489-4569-916c-db4baa7df110 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:20.951524 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d34ad4c6-4489-4569-916c-db4baa7df110 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:21.043611 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d34ad4c6-4489-4569-916c-db4baa7df110 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:21.049218 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=100 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:21.056171 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d34ad4c6-4489-4569-916c-db4baa7df110 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 200 len: 1330 microversion: 2.1 time: 0.128090 Sep 15 13:05:21.069552 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 296/598] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:20 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 1330 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:21.825631 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-24b6d01e-c192-44fa-83d3-b9dcabe49eea req-020aef22-8823-4d6e-9bc9-c8fd4e293883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f141686-0b27-4fd1-9e23-6634ade717ae", "tag": "2e211122-d0c5-4c5f-9b31-8e606a42abd5"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:21.836120 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-24b6d01e-c192-44fa-83d3-b9dcabe49eea req-020aef22-8823-4d6e-9bc9-c8fd4e293883 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:21.836692 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-24b6d01e-c192-44fa-83d3-b9dcabe49eea req-020aef22-8823-4d6e-9bc9-c8fd4e293883 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:21.837150 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-24b6d01e-c192-44fa-83d3-b9dcabe49eea req-020aef22-8823-4d6e-9bc9-c8fd4e293883 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:21.849597 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-24b6d01e-c192-44fa-83d3-b9dcabe49eea req-020aef22-8823-4d6e-9bc9-c8fd4e293883 service nova] Creating event network-changed:2e211122-d0c5-4c5f-9b31-8e606a42abd5 for instance 8f141686-0b27-4fd1-9e23-6634ade717ae on hv-cinder-83608 Sep 15 13:05:21.854937 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-24b6d01e-c192-44fa-83d3-b9dcabe49eea req-020aef22-8823-4d6e-9bc9-c8fd4e293883 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034156 Sep 15 13:05:21.855552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 303/599] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:05:22.081651 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5cb519d2-5bf7-40b7-99e7-ab1f9437abc0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:22.082353 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5cb519d2-5bf7-40b7-99e7-ab1f9437abc0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f4ff8111-8ab2-4e8d-8278-f76f69b76196] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:22.088673 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5cb519d2-5bf7-40b7-99e7-ab1f9437abc0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:22.089457 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5cb519d2-5bf7-40b7-99e7-ab1f9437abc0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:22.089900 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5cb519d2-5bf7-40b7-99e7-ab1f9437abc0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:22.090598 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5cb519d2-5bf7-40b7-99e7-ab1f9437abc0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:22.091259 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5cb519d2-5bf7-40b7-99e7-ab1f9437abc0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:22.091687 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5cb519d2-5bf7-40b7-99e7-ab1f9437abc0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:22.108671 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-5cb519d2-5bf7-40b7-99e7-ab1f9437abc0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] HTTP exception thrown: Instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 could not be found. Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5cb519d2-5bf7-40b7-99e7-ab1f9437abc0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Request method failure captured: Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 HTTP/1.1 Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyGGCvLr9NLDVLXNqodZA-HvHUau1u28TZ4av1Me93TUra2_ZrMm-nemJSD3Xgpnw_hfXFGIiBR73bkafisfR4v_bKp_0MCgPx-6n1Prv4poDN8_ciPTltTdBEeB323EV2ZAFZg2deCAbtg5TiCZqhByQgp7jHFDyyOpCDrtl1VhhtQ Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: ffff4b9feef3437cb5529aeaaacc3f86 Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:05:22.110934 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:05:22.112366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ffff4b9feef3437cb5529aeaaacc3f86", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ffff4b9feef3437cb5529aeaaacc3f86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ffff4b9feef3437cb5529aeaaacc3f86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ffff4b9feef3437cb5529aeaaacc3f86"}]}] Sep 15 13:05:22.112366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:05:22.112366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: ffff4b9feef3437cb5529aeaaacc3f86 Sep 15 13:05:22.112366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:05:22.112366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-ServerRescueNegativeTestJSON-1079457351-project Sep 15 13:05:22.112366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:05:22.112366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:05:22.112366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: e2ef1277bf944722aa33077985fb4734 Sep 15 13:05:22.112366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1079457351-project Sep 15 13:05:22.112366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:05:22.112366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 could not be found. Sep 15 13:05:22.112366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': 'f4ff8111-8ab2-4e8d-8278-f76f69b76196'} Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 could not be found. Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:05:22.113214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 could not be found. Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 could not be found. Sep 15 13:05:22.114514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:05:22.115985 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5cb519d2-5bf7-40b7-99e7-ab1f9437abc0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Returning 404 to user: Instance f4ff8111-8ab2-4e8d-8278-f76f69b76196 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:05:22.115985 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5cb519d2-5bf7-40b7-99e7-ab1f9437abc0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196" status: 404 len: 111 microversion: 2.1 time: 0.037075 Sep 15 13:05:22.115985 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 297/600] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:22 2022] GET /compute/v2.1/servers/f4ff8111-8ab2-4e8d-8278-f76f69b76196 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:05:22.123187 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-34e2d783-06a1-4bc6-843b-d80fe810f3ad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '.version_select at 0x7f62c560d550>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:22.143190 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-34e2d783-06a1-4bc6-843b-d80fe810f3ad tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-730077533" status: 202 len: 0 microversion: 2.1 time: 0.024152 Sep 15 13:05:22.143869 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 304/601] 10.222.0.57 () {58 vars in 1218 bytes} [Thu Sep 15 13:05:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-730077533 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 13:05:25.075615 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-513e5f26-16d2-4812-bc7e-ab834084c9f4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:25.076107 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-513e5f26-16d2-4812-bc7e-ab834084c9f4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:25.082677 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-513e5f26-16d2-4812-bc7e-ab834084c9f4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:25.083161 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-513e5f26-16d2-4812-bc7e-ab834084c9f4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:25.083877 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-513e5f26-16d2-4812-bc7e-ab834084c9f4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:25.084605 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-513e5f26-16d2-4812-bc7e-ab834084c9f4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:25.085061 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-513e5f26-16d2-4812-bc7e-ab834084c9f4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:25.085489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-513e5f26-16d2-4812-bc7e-ab834084c9f4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:25.111475 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-513e5f26-16d2-4812-bc7e-ab834084c9f4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Going to try to terminate instance {{(pid=120634) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:05:25.185706 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-513e5f26-16d2-4812-bc7e-ab834084c9f4 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 204 len: 0 microversion: 2.1 time: 0.113600 Sep 15 13:05:25.186547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 298/602] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:05:25 2022] DELETE /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:05:25.195464 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ff615e9b-c045-4a8f-95b4-96628ffa0afa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:25.196218 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ff615e9b-c045-4a8f-95b4-96628ffa0afa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:25.202344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff615e9b-c045-4a8f-95b4-96628ffa0afa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:25.202901 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff615e9b-c045-4a8f-95b4-96628ffa0afa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:25.203334 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff615e9b-c045-4a8f-95b4-96628ffa0afa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:25.204016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff615e9b-c045-4a8f-95b4-96628ffa0afa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:25.205060 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff615e9b-c045-4a8f-95b4-96628ffa0afa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:25.205483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff615e9b-c045-4a8f-95b4-96628ffa0afa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:25.333543 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ff615e9b-c045-4a8f-95b4-96628ffa0afa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:25.341135 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ff615e9b-c045-4a8f-95b4-96628ffa0afa tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1508 microversion: 2.1 time: 0.150488 Sep 15 13:05:25.341697 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 305/603] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:25 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:05:26.366101 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d72bdd8b-88b8-486c-a4b0-2bc5217491e7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:26.366730 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d72bdd8b-88b8-486c-a4b0-2bc5217491e7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:26.372677 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d72bdd8b-88b8-486c-a4b0-2bc5217491e7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:26.373171 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d72bdd8b-88b8-486c-a4b0-2bc5217491e7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:26.373611 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d72bdd8b-88b8-486c-a4b0-2bc5217491e7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:26.374318 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d72bdd8b-88b8-486c-a4b0-2bc5217491e7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:26.374772 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d72bdd8b-88b8-486c-a4b0-2bc5217491e7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:26.375195 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d72bdd8b-88b8-486c-a4b0-2bc5217491e7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:26.602165 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d72bdd8b-88b8-486c-a4b0-2bc5217491e7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:26.609973 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d72bdd8b-88b8-486c-a4b0-2bc5217491e7 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1508 microversion: 2.1 time: 0.248357 Sep 15 13:05:26.611053 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 299/604] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:26 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1508 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:26.881909 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-99cded29-c6b6-4914-8ece-e4118e53ab3e req-b978c643-ab60-420d-9adc-188d44507b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a7eade-1e1a-467f-a607-132c874cbb64", "name": "network-vif-deleted", "tag": "c0f58aee-58a1-4953-8f6b-d92d148c0d4d"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:26.892603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-99cded29-c6b6-4914-8ece-e4118e53ab3e req-b978c643-ab60-420d-9adc-188d44507b97 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:26.893440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-99cded29-c6b6-4914-8ece-e4118e53ab3e req-b978c643-ab60-420d-9adc-188d44507b97 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:26.893914 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-99cded29-c6b6-4914-8ece-e4118e53ab3e req-b978c643-ab60-420d-9adc-188d44507b97 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:26.907705 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-99cded29-c6b6-4914-8ece-e4118e53ab3e req-b978c643-ab60-420d-9adc-188d44507b97 service nova] Creating event network-vif-deleted:c0f58aee-58a1-4953-8f6b-d92d148c0d4d for instance f5a7eade-1e1a-467f-a607-132c874cbb64 on hv-cinder-83608 Sep 15 13:05:26.915836 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-99cded29-c6b6-4914-8ece-e4118e53ab3e req-b978c643-ab60-420d-9adc-188d44507b97 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037458 Sep 15 13:05:26.916478 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 306/605] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:05:27.632578 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-30442dfe-5e21-4ec0-9ebe-f7da83ac3aca tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:27.633211 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-30442dfe-5e21-4ec0-9ebe-f7da83ac3aca tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:27.639293 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30442dfe-5e21-4ec0-9ebe-f7da83ac3aca tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:27.639778 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30442dfe-5e21-4ec0-9ebe-f7da83ac3aca tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:27.640221 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30442dfe-5e21-4ec0-9ebe-f7da83ac3aca tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:27.640944 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30442dfe-5e21-4ec0-9ebe-f7da83ac3aca tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:27.641402 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30442dfe-5e21-4ec0-9ebe-f7da83ac3aca tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:27.642394 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30442dfe-5e21-4ec0-9ebe-f7da83ac3aca tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:27.675038 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30442dfe-5e21-4ec0-9ebe-f7da83ac3aca tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:27.675518 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30442dfe-5e21-4ec0-9ebe-f7da83ac3aca tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:27.675953 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-30442dfe-5e21-4ec0-9ebe-f7da83ac3aca tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:27.676436 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-30442dfe-5e21-4ec0-9ebe-f7da83ac3aca tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lazy-loading 'fault' on Instance uuid f5a7eade-1e1a-467f-a607-132c874cbb64 {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:05:27.716861 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-30442dfe-5e21-4ec0-9ebe-f7da83ac3aca tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:27.724508 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-30442dfe-5e21-4ec0-9ebe-f7da83ac3aca tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 200 len: 1311 microversion: 2.1 time: 0.095716 Sep 15 13:05:27.725004 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 300/606] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:27 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:28.747575 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d54463cc-b465-4c29-9033-986c835917b1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:28.748307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d54463cc-b465-4c29-9033-986c835917b1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: f5a7eade-1e1a-467f-a607-132c874cbb64] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:28.755133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d54463cc-b465-4c29-9033-986c835917b1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:28.755608 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d54463cc-b465-4c29-9033-986c835917b1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:28.756032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d54463cc-b465-4c29-9033-986c835917b1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:28.756735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d54463cc-b465-4c29-9033-986c835917b1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:28.757181 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d54463cc-b465-4c29-9033-986c835917b1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:28.757595 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d54463cc-b465-4c29-9033-986c835917b1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:28.770901 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-d54463cc-b465-4c29-9033-986c835917b1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] HTTP exception thrown: Instance f5a7eade-1e1a-467f-a607-132c874cbb64 could not be found. Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d54463cc-b465-4c29-9033-986c835917b1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Request method failure captured: Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 HTTP/1.1 Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyGGCvLr9NLDVLXNqodZA-HvHUau1u28TZ4av1Me93TUra2_ZrMm-nemJSD3Xgpnw_hfXFGIiBR73bkafisfR4v_bKp_0MCgPx-6n1Prv4poDN8_ciPTltTdBEeB323EV2ZAFZg2deCAbtg5TiCZqhByQgp7jHFDyyOpCDrtl1VhhtQ Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: ffff4b9feef3437cb5529aeaaacc3f86 Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:05:28.772501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:05:28.774000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ffff4b9feef3437cb5529aeaaacc3f86", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ffff4b9feef3437cb5529aeaaacc3f86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ffff4b9feef3437cb5529aeaaacc3f86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ffff4b9feef3437cb5529aeaaacc3f86"}]}] Sep 15 13:05:28.774000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:05:28.774000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: ffff4b9feef3437cb5529aeaaacc3f86 Sep 15 13:05:28.774000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:05:28.774000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-ServerRescueNegativeTestJSON-1079457351-project Sep 15 13:05:28.774000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:05:28.774000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:05:28.774000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: e2ef1277bf944722aa33077985fb4734 Sep 15 13:05:28.774000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1079457351-project Sep 15 13:05:28.774000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:05:28.774000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance f5a7eade-1e1a-467f-a607-132c874cbb64 could not be found. Sep 15 13:05:28.774000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': 'f5a7eade-1e1a-467f-a607-132c874cbb64'} Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a7eade-1e1a-467f-a607-132c874cbb64 could not be found. Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:05:28.774792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a7eade-1e1a-467f-a607-132c874cbb64 could not be found. Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a7eade-1e1a-467f-a607-132c874cbb64 could not be found. Sep 15 13:05:28.776211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:28.777587 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d54463cc-b465-4c29-9033-986c835917b1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Returning 404 to user: Instance f5a7eade-1e1a-467f-a607-132c874cbb64 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:05:28.777587 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d54463cc-b465-4c29-9033-986c835917b1 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64" status: 404 len: 111 microversion: 2.1 time: 0.030462 Sep 15 13:05:28.777587 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 307/607] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:28 2022] GET /compute/v2.1/servers/f5a7eade-1e1a-467f-a607-132c874cbb64 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:05:28.782986 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ee57fa1f-0e8e-4fa9-b028-3bc3307f7064 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:28.783496 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ee57fa1f-0e8e-4fa9-b028-3bc3307f7064 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:28.789473 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ee57fa1f-0e8e-4fa9-b028-3bc3307f7064 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:28.789956 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ee57fa1f-0e8e-4fa9-b028-3bc3307f7064 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:28.790392 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ee57fa1f-0e8e-4fa9-b028-3bc3307f7064 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:28.791080 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ee57fa1f-0e8e-4fa9-b028-3bc3307f7064 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:28.791533 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ee57fa1f-0e8e-4fa9-b028-3bc3307f7064 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:28.791958 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ee57fa1f-0e8e-4fa9-b028-3bc3307f7064 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:28.816961 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ee57fa1f-0e8e-4fa9-b028-3bc3307f7064 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Going to try to terminate instance {{(pid=120634) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:05:28.889713 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ee57fa1f-0e8e-4fa9-b028-3bc3307f7064 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 204 len: 0 microversion: 2.1 time: 0.110871 Sep 15 13:05:28.890383 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 301/608] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:05:28 2022] DELETE /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:05:28.900167 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5f132f61-61c6-4814-8c08-f599ae6ef201 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:28.900806 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-5f132f61-61c6-4814-8c08-f599ae6ef201 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:28.906916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f132f61-61c6-4814-8c08-f599ae6ef201 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:28.908125 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f132f61-61c6-4814-8c08-f599ae6ef201 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:28.908688 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f132f61-61c6-4814-8c08-f599ae6ef201 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:28.909396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f132f61-61c6-4814-8c08-f599ae6ef201 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:28.909837 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f132f61-61c6-4814-8c08-f599ae6ef201 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:28.910258 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f132f61-61c6-4814-8c08-f599ae6ef201 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:29.038628 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-5f132f61-61c6-4814-8c08-f599ae6ef201 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:29.046324 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-5f132f61-61c6-4814-8c08-f599ae6ef201 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.150207 Sep 15 13:05:29.046881 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 308/609] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:28 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:30.070533 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a4cb1ccc-4757-4f0c-9b1a-6d80c04ed3b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:30.071239 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a4cb1ccc-4757-4f0c-9b1a-6d80c04ed3b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:30.077215 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a4cb1ccc-4757-4f0c-9b1a-6d80c04ed3b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:30.077638 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a4cb1ccc-4757-4f0c-9b1a-6d80c04ed3b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:30.078069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a4cb1ccc-4757-4f0c-9b1a-6d80c04ed3b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:30.078756 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a4cb1ccc-4757-4f0c-9b1a-6d80c04ed3b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:30.079854 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a4cb1ccc-4757-4f0c-9b1a-6d80c04ed3b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:30.080316 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a4cb1ccc-4757-4f0c-9b1a-6d80c04ed3b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:30.207859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a4cb1ccc-4757-4f0c-9b1a-6d80c04ed3b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:30.215462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a4cb1ccc-4757-4f0c-9b1a-6d80c04ed3b0 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.149179 Sep 15 13:05:30.216025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 302/610] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:30 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:31.239120 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a13ce450-e642-4c49-ae98-c437dd1e4118 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:31.239720 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a13ce450-e642-4c49-ae98-c437dd1e4118 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:31.241788 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:31.247043 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a13ce450-e642-4c49-ae98-c437dd1e4118 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:31.247518 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a13ce450-e642-4c49-ae98-c437dd1e4118 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:31.247945 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a13ce450-e642-4c49-ae98-c437dd1e4118 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:31.248656 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a13ce450-e642-4c49-ae98-c437dd1e4118 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:31.249107 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a13ce450-e642-4c49-ae98-c437dd1e4118 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:31.249529 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a13ce450-e642-4c49-ae98-c437dd1e4118 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:31.386846 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a13ce450-e642-4c49-ae98-c437dd1e4118 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:31.395495 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a13ce450-e642-4c49-ae98-c437dd1e4118 tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1521 microversion: 2.1 time: 0.160672 Sep 15 13:05:31.396063 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 309/611] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:31 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:05:32.195662 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-d61d9357-4620-4bd7-b51e-884e6651a877 req-cb0d04b7-bc2c-4782-a8e3-725f9e3ac7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19c1c10-a0cf-4be2-907e-d210ec6cddbb", "name": "network-vif-deleted", "tag": "f63af2cc-ef44-4098-a900-c09daa2c63e4"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:32.201535 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:32.208804 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-d61d9357-4620-4bd7-b51e-884e6651a877 req-cb0d04b7-bc2c-4782-a8e3-725f9e3ac7c8 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:32.209285 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-d61d9357-4620-4bd7-b51e-884e6651a877 req-cb0d04b7-bc2c-4782-a8e3-725f9e3ac7c8 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:32.209714 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-d61d9357-4620-4bd7-b51e-884e6651a877 req-cb0d04b7-bc2c-4782-a8e3-725f9e3ac7c8 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:32.222219 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-d61d9357-4620-4bd7-b51e-884e6651a877 req-cb0d04b7-bc2c-4782-a8e3-725f9e3ac7c8 service nova] Creating event network-vif-deleted:f63af2cc-ef44-4098-a900-c09daa2c63e4 for instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb on hv-cinder-83608 Sep 15 13:05:32.227204 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-d61d9357-4620-4bd7-b51e-884e6651a877 req-cb0d04b7-bc2c-4782-a8e3-725f9e3ac7c8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035142 Sep 15 13:05:32.228020 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 303/612] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:05:32.418501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-332b4f5c-55d4-4db9-b577-ddbcdee7497f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:32.419254 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-332b4f5c-55d4-4db9-b577-ddbcdee7497f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:32.426103 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-332b4f5c-55d4-4db9-b577-ddbcdee7497f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:32.426590 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-332b4f5c-55d4-4db9-b577-ddbcdee7497f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:32.427024 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-332b4f5c-55d4-4db9-b577-ddbcdee7497f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:32.427753 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-332b4f5c-55d4-4db9-b577-ddbcdee7497f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:32.428205 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-332b4f5c-55d4-4db9-b577-ddbcdee7497f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:32.428853 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-332b4f5c-55d4-4db9-b577-ddbcdee7497f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:32.462394 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-332b4f5c-55d4-4db9-b577-ddbcdee7497f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:32.462907 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-332b4f5c-55d4-4db9-b577-ddbcdee7497f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:32.463306 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-332b4f5c-55d4-4db9-b577-ddbcdee7497f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:32.463946 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-332b4f5c-55d4-4db9-b577-ddbcdee7497f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lazy-loading 'fault' on Instance uuid b19c1c10-a0cf-4be2-907e-d210ec6cddbb {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:05:32.507718 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-332b4f5c-55d4-4db9-b577-ddbcdee7497f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ef1277bf944722aa33077985fb4734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffff4b9feef3437cb5529aeaaacc3f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:32.519960 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-332b4f5c-55d4-4db9-b577-ddbcdee7497f tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 200 len: 1311 microversion: 2.1 time: 0.104952 Sep 15 13:05:32.520809 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 310/613] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:32 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:33.543542 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e113e306-3a6b-4bac-843c-ec49888fb90a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:33.544234 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-e113e306-3a6b-4bac-843c-ec49888fb90a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] [instance: b19c1c10-a0cf-4be2-907e-d210ec6cddbb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:33.551196 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e113e306-3a6b-4bac-843c-ec49888fb90a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:33.551669 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e113e306-3a6b-4bac-843c-ec49888fb90a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:33.552097 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e113e306-3a6b-4bac-843c-ec49888fb90a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:33.552809 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e113e306-3a6b-4bac-843c-ec49888fb90a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:33.553255 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e113e306-3a6b-4bac-843c-ec49888fb90a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:33.553669 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e113e306-3a6b-4bac-843c-ec49888fb90a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:33.567228 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-e113e306-3a6b-4bac-843c-ec49888fb90a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] HTTP exception thrown: Instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb could not be found. Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e113e306-3a6b-4bac-843c-ec49888fb90a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Request method failure captured: Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb HTTP/1.1 Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyGGCvLr9NLDVLXNqodZA-HvHUau1u28TZ4av1Me93TUra2_ZrMm-nemJSD3Xgpnw_hfXFGIiBR73bkafisfR4v_bKp_0MCgPx-6n1Prv4poDN8_ciPTltTdBEeB323EV2ZAFZg2deCAbtg5TiCZqhByQgp7jHFDyyOpCDrtl1VhhtQ Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: ffff4b9feef3437cb5529aeaaacc3f86 Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:05:33.568820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:05:33.570441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ffff4b9feef3437cb5529aeaaacc3f86", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ffff4b9feef3437cb5529aeaaacc3f86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ffff4b9feef3437cb5529aeaaacc3f86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ffff4b9feef3437cb5529aeaaacc3f86"}]}] Sep 15 13:05:33.570441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:05:33.570441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: ffff4b9feef3437cb5529aeaaacc3f86 Sep 15 13:05:33.570441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1079457351 Sep 15 13:05:33.570441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-ServerRescueNegativeTestJSON-1079457351-project Sep 15 13:05:33.570441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:05:33.570441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:05:33.570441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: e2ef1277bf944722aa33077985fb4734 Sep 15 13:05:33.570441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1079457351-project Sep 15 13:05:33.570441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:05:33.570441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb could not be found. Sep 15 13:05:33.570441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': 'b19c1c10-a0cf-4be2-907e-d210ec6cddbb'} Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb could not be found. Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:05:33.571388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb could not be found. Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb could not be found. Sep 15 13:05:33.572889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:05:33.574210 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e113e306-3a6b-4bac-843c-ec49888fb90a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] Returning 404 to user: Instance b19c1c10-a0cf-4be2-907e-d210ec6cddbb could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:05:33.574210 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e113e306-3a6b-4bac-843c-ec49888fb90a tempest-ServerRescueNegativeTestJSON-1079457351 tempest-ServerRescueNegativeTestJSON-1079457351-project] 10.222.0.57 "GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb" status: 404 len: 111 microversion: 2.1 time: 0.031223 Sep 15 13:05:33.574210 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 304/614] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:33 2022] GET /compute/v2.1/servers/b19c1c10-a0cf-4be2-907e-d210ec6cddbb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:05:36.509231 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ab7dc74e-6491-4e83-9e0e-4df22f5ba016 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:36.509768 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ab7dc74e-6491-4e83-9e0e-4df22f5ba016 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:36.516683 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab7dc74e-6491-4e83-9e0e-4df22f5ba016 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:36.517180 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab7dc74e-6491-4e83-9e0e-4df22f5ba016 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:36.518165 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab7dc74e-6491-4e83-9e0e-4df22f5ba016 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:36.519032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab7dc74e-6491-4e83-9e0e-4df22f5ba016 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:36.519490 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab7dc74e-6491-4e83-9e0e-4df22f5ba016 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:36.520174 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab7dc74e-6491-4e83-9e0e-4df22f5ba016 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:36.551198 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-ab7dc74e-6491-4e83-9e0e-4df22f5ba016 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lazy-loading 'flavor' on Instance uuid e2628b91-c3d5-4bc0-88ed-c6786c051876 {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:05:36.634098 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ab7dc74e-6491-4e83-9e0e-4df22f5ba016 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "POST /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876/action" status: 202 len: 0 microversion: 2.1 time: 0.128602 Sep 15 13:05:36.638591 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 311/615] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Sep 15 13:05:36 2022] POST /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:05:36.645609 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-9970bc98-d731-4ebb-852f-b6bfd1d52816 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:36.646805 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-9970bc98-d731-4ebb-852f-b6bfd1d52816 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:36.653545 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9970bc98-d731-4ebb-852f-b6bfd1d52816 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:36.654089 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9970bc98-d731-4ebb-852f-b6bfd1d52816 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:36.654625 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9970bc98-d731-4ebb-852f-b6bfd1d52816 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:36.655500 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9970bc98-d731-4ebb-852f-b6bfd1d52816 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:36.656114 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9970bc98-d731-4ebb-852f-b6bfd1d52816 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:36.656776 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9970bc98-d731-4ebb-852f-b6bfd1d52816 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:37.194629 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9970bc98-d731-4ebb-852f-b6bfd1d52816 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:37.202464 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-9970bc98-d731-4ebb-852f-b6bfd1d52816 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.563033 Sep 15 13:05:37.203024 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 305/616] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:36 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:38.227032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f928badf-fc67-4ed9-91f1-5cdec4d351c3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:38.227732 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f928badf-fc67-4ed9-91f1-5cdec4d351c3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:38.234223 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f928badf-fc67-4ed9-91f1-5cdec4d351c3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:38.234700 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f928badf-fc67-4ed9-91f1-5cdec4d351c3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:38.235127 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f928badf-fc67-4ed9-91f1-5cdec4d351c3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:38.235806 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f928badf-fc67-4ed9-91f1-5cdec4d351c3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:38.236896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f928badf-fc67-4ed9-91f1-5cdec4d351c3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:38.237662 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f928badf-fc67-4ed9-91f1-5cdec4d351c3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:38.377975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f928badf-fc67-4ed9-91f1-5cdec4d351c3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:38.386009 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f928badf-fc67-4ed9-91f1-5cdec4d351c3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.163086 Sep 15 13:05:38.386585 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 312/617] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:38 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:39.410358 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4685acfe-ef81-4edd-a536-c906afb63d8b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:39.410868 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-4685acfe-ef81-4edd-a536-c906afb63d8b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:39.417087 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4685acfe-ef81-4edd-a536-c906afb63d8b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:39.417571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4685acfe-ef81-4edd-a536-c906afb63d8b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:39.418010 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4685acfe-ef81-4edd-a536-c906afb63d8b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:39.418692 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4685acfe-ef81-4edd-a536-c906afb63d8b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:39.419140 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4685acfe-ef81-4edd-a536-c906afb63d8b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:39.419557 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4685acfe-ef81-4edd-a536-c906afb63d8b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:39.552040 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-4685acfe-ef81-4edd-a536-c906afb63d8b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:39.559693 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-4685acfe-ef81-4edd-a536-c906afb63d8b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.153254 Sep 15 13:05:39.560246 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 306/618] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:39 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:40.583428 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-56735273-f5ef-4227-8a01-561ab36ae49e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:40.584856 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-56735273-f5ef-4227-8a01-561ab36ae49e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:40.592503 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-56735273-f5ef-4227-8a01-561ab36ae49e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:40.592996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-56735273-f5ef-4227-8a01-561ab36ae49e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:40.593433 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-56735273-f5ef-4227-8a01-561ab36ae49e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:40.594136 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-56735273-f5ef-4227-8a01-561ab36ae49e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:40.594588 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-56735273-f5ef-4227-8a01-561ab36ae49e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:40.595045 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-56735273-f5ef-4227-8a01-561ab36ae49e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:40.724789 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-56735273-f5ef-4227-8a01-561ab36ae49e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:40.732407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-56735273-f5ef-4227-8a01-561ab36ae49e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.153028 Sep 15 13:05:40.732967 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 313/619] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:40 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:41.755800 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8eb749d9-e012-4e86-8da1-94184f3373e3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:41.756443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8eb749d9-e012-4e86-8da1-94184f3373e3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:41.762322 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8eb749d9-e012-4e86-8da1-94184f3373e3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:41.762801 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8eb749d9-e012-4e86-8da1-94184f3373e3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:41.763237 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8eb749d9-e012-4e86-8da1-94184f3373e3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:41.763925 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8eb749d9-e012-4e86-8da1-94184f3373e3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:41.764399 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8eb749d9-e012-4e86-8da1-94184f3373e3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:41.764818 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8eb749d9-e012-4e86-8da1-94184f3373e3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:41.914147 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8eb749d9-e012-4e86-8da1-94184f3373e3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:41.921915 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8eb749d9-e012-4e86-8da1-94184f3373e3 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.170276 Sep 15 13:05:41.922477 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 307/620] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:41 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:42.945381 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d7289766-e634-43b8-b0db-1f4f54ee1601 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:42.946017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d7289766-e634-43b8-b0db-1f4f54ee1601 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:42.952441 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d7289766-e634-43b8-b0db-1f4f54ee1601 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:42.952929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d7289766-e634-43b8-b0db-1f4f54ee1601 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:42.953388 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d7289766-e634-43b8-b0db-1f4f54ee1601 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:42.954082 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d7289766-e634-43b8-b0db-1f4f54ee1601 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:42.954533 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d7289766-e634-43b8-b0db-1f4f54ee1601 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:42.955673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d7289766-e634-43b8-b0db-1f4f54ee1601 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:43.083238 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d7289766-e634-43b8-b0db-1f4f54ee1601 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:43.091656 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d7289766-e634-43b8-b0db-1f4f54ee1601 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.150082 Sep 15 13:05:43.092229 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 314/621] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:42 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:44.115528 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d1958f62-3dce-40d8-96cf-b7e33434b940 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:44.116167 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d1958f62-3dce-40d8-96cf-b7e33434b940 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:44.122121 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d1958f62-3dce-40d8-96cf-b7e33434b940 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:44.122608 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d1958f62-3dce-40d8-96cf-b7e33434b940 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:44.123044 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d1958f62-3dce-40d8-96cf-b7e33434b940 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:44.123733 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d1958f62-3dce-40d8-96cf-b7e33434b940 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:44.124184 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d1958f62-3dce-40d8-96cf-b7e33434b940 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:44.124755 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d1958f62-3dce-40d8-96cf-b7e33434b940 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:44.256789 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d1958f62-3dce-40d8-96cf-b7e33434b940 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:44.264403 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d1958f62-3dce-40d8-96cf-b7e33434b940 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.153440 Sep 15 13:05:44.264966 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 308/622] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:44 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:45.287394 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-14536a04-e676-4326-980a-399bc09e923e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:45.288003 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-14536a04-e676-4326-980a-399bc09e923e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:45.294429 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-14536a04-e676-4326-980a-399bc09e923e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:45.294943 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-14536a04-e676-4326-980a-399bc09e923e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:45.295377 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-14536a04-e676-4326-980a-399bc09e923e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:45.296066 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-14536a04-e676-4326-980a-399bc09e923e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:45.296544 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-14536a04-e676-4326-980a-399bc09e923e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:45.296970 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-14536a04-e676-4326-980a-399bc09e923e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:45.315976 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:45.429656 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-14536a04-e676-4326-980a-399bc09e923e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:45.437303 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-14536a04-e676-4326-980a-399bc09e923e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.153786 Sep 15 13:05:45.437870 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 315/623] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:45 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:46.460794 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f61db076-0ab4-4b6b-b65e-8f564af24423 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:46.461417 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f61db076-0ab4-4b6b-b65e-8f564af24423 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:46.467246 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f61db076-0ab4-4b6b-b65e-8f564af24423 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:46.467735 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f61db076-0ab4-4b6b-b65e-8f564af24423 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:46.468178 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f61db076-0ab4-4b6b-b65e-8f564af24423 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:46.468896 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f61db076-0ab4-4b6b-b65e-8f564af24423 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:46.469353 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f61db076-0ab4-4b6b-b65e-8f564af24423 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:46.469779 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f61db076-0ab4-4b6b-b65e-8f564af24423 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:46.603975 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f61db076-0ab4-4b6b-b65e-8f564af24423 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:46.612661 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f61db076-0ab4-4b6b-b65e-8f564af24423 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.155713 Sep 15 13:05:46.613235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 309/624] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:46 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:46.650362 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a3569b57-68db-4d15-966c-d824595edd1e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:46.652624 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a3569b57-68db-4d15-966c-d824595edd1e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:46.659759 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a3569b57-68db-4d15-966c-d824595edd1e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:46.660245 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a3569b57-68db-4d15-966c-d824595edd1e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:46.660703 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a3569b57-68db-4d15-966c-d824595edd1e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:46.661392 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a3569b57-68db-4d15-966c-d824595edd1e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:46.661844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a3569b57-68db-4d15-966c-d824595edd1e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:46.662266 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a3569b57-68db-4d15-966c-d824595edd1e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:46.691773 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a3569b57-68db-4d15-966c-d824595edd1e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045328 Sep 15 13:05:46.692340 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 316/625] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:05:46 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 13:05:46.755454 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b3fbf523-4159-429d-8931-1019862e007c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:46.755951 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b3fbf523-4159-429d-8931-1019862e007c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:46.761773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b3fbf523-4159-429d-8931-1019862e007c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:46.762248 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b3fbf523-4159-429d-8931-1019862e007c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:46.762679 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b3fbf523-4159-429d-8931-1019862e007c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:46.763364 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b3fbf523-4159-429d-8931-1019862e007c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:46.763815 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b3fbf523-4159-429d-8931-1019862e007c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:46.764235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b3fbf523-4159-429d-8931-1019862e007c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:46.789148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b3fbf523-4159-429d-8931-1019862e007c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Going to try to terminate instance {{(pid=120634) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:05:46.822815 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:46.864726 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b3fbf523-4159-429d-8931-1019862e007c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 204 len: 0 microversion: 2.1 time: 0.112834 Sep 15 13:05:46.865225 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 310/626] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:05:46 2022] DELETE /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:05:46.873191 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a1d75739-ac9a-4691-8c18-2a2df80ccd39 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:46.873802 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a1d75739-ac9a-4691-8c18-2a2df80ccd39 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:46.879897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a1d75739-ac9a-4691-8c18-2a2df80ccd39 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:46.880434 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a1d75739-ac9a-4691-8c18-2a2df80ccd39 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:46.880862 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a1d75739-ac9a-4691-8c18-2a2df80ccd39 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:46.881539 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a1d75739-ac9a-4691-8c18-2a2df80ccd39 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:46.881983 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a1d75739-ac9a-4691-8c18-2a2df80ccd39 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:46.882397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a1d75739-ac9a-4691-8c18-2a2df80ccd39 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:47.017665 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a1d75739-ac9a-4691-8c18-2a2df80ccd39 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:47.025896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a1d75739-ac9a-4691-8c18-2a2df80ccd39 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1670 microversion: 2.1 time: 0.156410 Sep 15 13:05:47.026472 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 317/627] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:46 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:47.636651 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-13af2024-2f8a-48ef-8804-e3991121dd24 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:47.637424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-13af2024-2f8a-48ef-8804-e3991121dd24 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:47.643534 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13af2024-2f8a-48ef-8804-e3991121dd24 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:47.644014 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13af2024-2f8a-48ef-8804-e3991121dd24 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:47.645306 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13af2024-2f8a-48ef-8804-e3991121dd24 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:47.646014 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13af2024-2f8a-48ef-8804-e3991121dd24 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:47.646448 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13af2024-2f8a-48ef-8804-e3991121dd24 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:47.646863 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13af2024-2f8a-48ef-8804-e3991121dd24 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:47.779255 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-13af2024-2f8a-48ef-8804-e3991121dd24 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:47.787585 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-13af2024-2f8a-48ef-8804-e3991121dd24 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.155329 Sep 15 13:05:47.788149 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 311/628] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:47 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:48.049174 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8ae15274-8c1b-4caf-afe5-62997606a28d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:48.050066 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-8ae15274-8c1b-4caf-afe5-62997606a28d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:48.057289 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8ae15274-8c1b-4caf-afe5-62997606a28d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:48.057855 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8ae15274-8c1b-4caf-afe5-62997606a28d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:48.058293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8ae15274-8c1b-4caf-afe5-62997606a28d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:48.058986 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8ae15274-8c1b-4caf-afe5-62997606a28d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:48.059438 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8ae15274-8c1b-4caf-afe5-62997606a28d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:48.059874 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8ae15274-8c1b-4caf-afe5-62997606a28d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:48.407960 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-8ae15274-8c1b-4caf-afe5-62997606a28d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:48.415680 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8ae15274-8c1b-4caf-afe5-62997606a28d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1670 microversion: 2.1 time: 0.370516 Sep 15 13:05:48.416241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 318/629] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:48 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1670 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:48.810080 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0a44df07-6cc3-42c1-9239-ce99a5793a4b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:48.810667 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0a44df07-6cc3-42c1-9239-ce99a5793a4b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:48.818233 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a44df07-6cc3-42c1-9239-ce99a5793a4b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:48.818822 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a44df07-6cc3-42c1-9239-ce99a5793a4b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:48.819472 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a44df07-6cc3-42c1-9239-ce99a5793a4b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:48.820501 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a44df07-6cc3-42c1-9239-ce99a5793a4b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:48.821157 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a44df07-6cc3-42c1-9239-ce99a5793a4b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:48.821600 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a44df07-6cc3-42c1-9239-ce99a5793a4b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:49.108693 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0a44df07-6cc3-42c1-9239-ce99a5793a4b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:49.116776 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0a44df07-6cc3-42c1-9239-ce99a5793a4b tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.310721 Sep 15 13:05:49.117350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 312/630] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:48 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:49.438970 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e37d5f35-d51d-4afe-92ed-e3a4c71c9016 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:49.439580 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e37d5f35-d51d-4afe-92ed-e3a4c71c9016 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:49.446838 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e37d5f35-d51d-4afe-92ed-e3a4c71c9016 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:49.447321 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e37d5f35-d51d-4afe-92ed-e3a4c71c9016 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:49.447752 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e37d5f35-d51d-4afe-92ed-e3a4c71c9016 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:49.448470 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e37d5f35-d51d-4afe-92ed-e3a4c71c9016 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:49.448914 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e37d5f35-d51d-4afe-92ed-e3a4c71c9016 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:49.449347 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e37d5f35-d51d-4afe-92ed-e3a4c71c9016 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:49.511087 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e37d5f35-d51d-4afe-92ed-e3a4c71c9016 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:49.518768 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e37d5f35-d51d-4afe-92ed-e3a4c71c9016 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1603 microversion: 2.1 time: 0.083592 Sep 15 13:05:49.532308 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 319/631] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:49 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1603 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:49.665277 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-15fbca37-9d01-49eb-8213-281efa630a23 req-b925bc77-5471-4113-bd00-c69dc414bb0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7538af-56ab-4022-85eb-172a1ee55d71", "name": "network-vif-deleted", "tag": "71e9592f-0e8b-403c-bbfd-bae6e0da6f5f"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:49.675117 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-15fbca37-9d01-49eb-8213-281efa630a23 req-b925bc77-5471-4113-bd00-c69dc414bb0c service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:49.676361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-15fbca37-9d01-49eb-8213-281efa630a23 req-b925bc77-5471-4113-bd00-c69dc414bb0c service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:49.676678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-15fbca37-9d01-49eb-8213-281efa630a23 req-b925bc77-5471-4113-bd00-c69dc414bb0c service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:49.688512 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-15fbca37-9d01-49eb-8213-281efa630a23 req-b925bc77-5471-4113-bd00-c69dc414bb0c service nova] Creating event network-vif-deleted:71e9592f-0e8b-403c-bbfd-bae6e0da6f5f for instance 2c7538af-56ab-4022-85eb-172a1ee55d71 on hv-cinder-83608 Sep 15 13:05:49.693727 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-15fbca37-9d01-49eb-8213-281efa630a23 req-b925bc77-5471-4113-bd00-c69dc414bb0c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032140 Sep 15 13:05:49.694513 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 313/632] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:05:50.141703 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-64ef42ee-0910-4177-85a9-59ca8cbfdc71 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:50.142378 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-64ef42ee-0910-4177-85a9-59ca8cbfdc71 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:50.148895 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-64ef42ee-0910-4177-85a9-59ca8cbfdc71 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:50.149383 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-64ef42ee-0910-4177-85a9-59ca8cbfdc71 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:50.149813 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-64ef42ee-0910-4177-85a9-59ca8cbfdc71 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:50.150784 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-64ef42ee-0910-4177-85a9-59ca8cbfdc71 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:50.150988 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-64ef42ee-0910-4177-85a9-59ca8cbfdc71 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:50.151370 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-64ef42ee-0910-4177-85a9-59ca8cbfdc71 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:50.312057 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-64ef42ee-0910-4177-85a9-59ca8cbfdc71 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:50.325504 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-64ef42ee-0910-4177-85a9-59ca8cbfdc71 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.187797 Sep 15 13:05:50.326299 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 320/633] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:50 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:50.543854 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5311a666-a12c-4eaa-9519-87da8b9bf6b9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:50.544607 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5311a666-a12c-4eaa-9519-87da8b9bf6b9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:50.551475 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5311a666-a12c-4eaa-9519-87da8b9bf6b9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:50.552057 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5311a666-a12c-4eaa-9519-87da8b9bf6b9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:50.552520 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5311a666-a12c-4eaa-9519-87da8b9bf6b9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:50.553251 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5311a666-a12c-4eaa-9519-87da8b9bf6b9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:50.553703 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5311a666-a12c-4eaa-9519-87da8b9bf6b9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:50.554127 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5311a666-a12c-4eaa-9519-87da8b9bf6b9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:50.620610 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5311a666-a12c-4eaa-9519-87da8b9bf6b9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:50.630525 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5311a666-a12c-4eaa-9519-87da8b9bf6b9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 200 len: 1322 microversion: 2.1 time: 0.090866 Sep 15 13:05:50.631117 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 314/634] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:50 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 1322 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:51.350031 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-71768cf0-0083-4198-a61e-2f2471b0582a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:51.350641 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-71768cf0-0083-4198-a61e-2f2471b0582a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:51.357148 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71768cf0-0083-4198-a61e-2f2471b0582a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:51.357634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71768cf0-0083-4198-a61e-2f2471b0582a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:51.358063 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71768cf0-0083-4198-a61e-2f2471b0582a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:51.359173 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71768cf0-0083-4198-a61e-2f2471b0582a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:51.359270 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71768cf0-0083-4198-a61e-2f2471b0582a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:51.359612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-71768cf0-0083-4198-a61e-2f2471b0582a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:51.500285 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-71768cf0-0083-4198-a61e-2f2471b0582a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:51.509051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-71768cf0-0083-4198-a61e-2f2471b0582a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1572 microversion: 2.1 time: 0.162897 Sep 15 13:05:51.509653 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 321/635] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:51 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:51.532323 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4b6daf19-a643-4db5-bd7b-143758e6238f tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:51.532655 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-4b6daf19-a643-4db5-bd7b-143758e6238f tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:51.542717 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4b6daf19-a643-4db5-bd7b-143758e6238f tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:51.543569 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4b6daf19-a643-4db5-bd7b-143758e6238f tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:51.544975 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4b6daf19-a643-4db5-bd7b-143758e6238f tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:51.546245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4b6daf19-a643-4db5-bd7b-143758e6238f tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:51.546768 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4b6daf19-a643-4db5-bd7b-143758e6238f tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:51.547340 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4b6daf19-a643-4db5-bd7b-143758e6238f tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:51.593314 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-4b6daf19-a643-4db5-bd7b-143758e6238f tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120634) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 13:05:51.657127 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-32c6cd5a-131f-43b6-97b1-6716d03d5098 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:51.657780 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-32c6cd5a-131f-43b6-97b1-6716d03d5098 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:51.673818 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-32c6cd5a-131f-43b6-97b1-6716d03d5098 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:51.674374 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-32c6cd5a-131f-43b6-97b1-6716d03d5098 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:51.674817 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-32c6cd5a-131f-43b6-97b1-6716d03d5098 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:51.675661 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-32c6cd5a-131f-43b6-97b1-6716d03d5098 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:51.676438 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-32c6cd5a-131f-43b6-97b1-6716d03d5098 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:51.676895 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-32c6cd5a-131f-43b6-97b1-6716d03d5098 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:51.682503 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-4b6daf19-a643-4db5-bd7b-143758e6238f tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "POST /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876/action" status: 202 len: 0 microversion: 2.1 time: 0.154435 Sep 15 13:05:51.683142 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 315/636] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Sep 15 13:05:51 2022] POST /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:05:51.692062 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-507f7a2e-b002-4941-90e5-0ef3e5370404 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:51.692555 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-32c6cd5a-131f-43b6-97b1-6716d03d5098 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] HTTP exception thrown: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:05:51.692712 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-507f7a2e-b002-4941-90e5-0ef3e5370404 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-32c6cd5a-131f-43b6-97b1-6716d03d5098 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Request method failure captured: Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 HTTP/1.1 Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyF_HvhWG79Hexes3j0nPFKMSzaMlHwMn1bgsBBj7Nk70pYDgFfnYTVwa54-Vz2bEvRy1sJ19eqb5i_BZvDteyGukFrtDQlkFod7XYLeRyEQKeZqcadw47tSirWMeIebNL4k0p-QIWT6qpKviFxQZr6JBJFsU6Fuel_Xer36pEVnzYk Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 27776e610cf84b49af0fec4b95aa31f3 Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:05:51.694810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:05:51.696133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_27776e610cf84b49af0fec4b95aa31f3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/27776e610cf84b49af0fec4b95aa31f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/27776e610cf84b49af0fec4b95aa31f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/27776e610cf84b49af0fec4b95aa31f3"}]}] Sep 15 13:05:51.696133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:05:51.696133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 27776e610cf84b49af0fec4b95aa31f3 Sep 15 13:05:51.696133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:05:51.696133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeTestJSON-651599207-project Sep 15 13:05:51.696133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:05:51.696133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:05:51.696133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: cff1145566f1408a9a22da9088581024 Sep 15 13:05:51.696133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeTestJSON-651599207-project Sep 15 13:05:51.696133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:05:51.696133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:05:51.696133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '2c7538af-56ab-4022-85eb-172a1ee55d71'} Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:05:51.697207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:05:51.698469 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:05:51.700153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-32c6cd5a-131f-43b6-97b1-6716d03d5098 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Returning 404 to user: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:05:51.700153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-32c6cd5a-131f-43b6-97b1-6716d03d5098 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 404 len: 111 microversion: 2.1 time: 0.044776 Sep 15 13:05:51.700153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 322/637] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:51 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 13:05:51.701029 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-507f7a2e-b002-4941-90e5-0ef3e5370404 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:51.701516 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-507f7a2e-b002-4941-90e5-0ef3e5370404 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:51.701948 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-507f7a2e-b002-4941-90e5-0ef3e5370404 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:51.702641 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-507f7a2e-b002-4941-90e5-0ef3e5370404 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:51.703120 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-507f7a2e-b002-4941-90e5-0ef3e5370404 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:51.703537 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-507f7a2e-b002-4941-90e5-0ef3e5370404 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:51.709515 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0f3dbb07-3cbb-4b43-a6fe-14671b69b9dd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '.version_select at 0x7f62c56b6790>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:51.730956 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0f3dbb07-3cbb-4b43-a6fe-14671b69b9dd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969191459" status: 202 len: 0 microversion: 2.1 time: 0.025520 Sep 15 13:05:51.731707 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 323/638] 10.222.0.57 () {58 vars in 1221 bytes} [Thu Sep 15 13:05:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969191459 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:05:51.868829 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-507f7a2e-b002-4941-90e5-0ef3e5370404 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:51.876853 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-507f7a2e-b002-4941-90e5-0ef3e5370404 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1520 microversion: 2.1 time: 0.189106 Sep 15 13:05:51.892905 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 316/639] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:51 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:05:52.405385 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b68bf545-c939-4c60-b5ff-3f2030b530b2 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Action: 'create', calling method: .version_select at 0x7f62c54a29d0>, body: {"keypair": {"name": "tempest-keypair-1647303996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4aFx2sYpyzkS9wd0pSFZ1JJHtOMIaEAfPzlh4ephMcI1d/gdWWrZRs0GzH6deNaRbNBPPwuMv9nKutdQk87A6qHyCW7tpx7c90el2k6ZiKhsXQc4IiVekSe41qJBuCyA=="}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:52.422437 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-b68bf545-c939-4c60-b5ff-3f2030b530b2 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Getting quotas for project 27776e610cf84b49af0fec4b95aa31f3. Resources: {'key_pairs'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:05:52.428000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-b68bf545-c939-4c60-b5ff-3f2030b530b2 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Getting quotas for user cff1145566f1408a9a22da9088581024 and project 27776e610cf84b49af0fec4b95aa31f3. Resources: {'key_pairs'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:05:52.453185 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b68bf545-c939-4c60-b5ff-3f2030b530b2 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051950 Sep 15 13:05:52.454188 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 324/640] 10.222.0.57 () {60 vars in 1159 bytes} [Thu Sep 15 13:05:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:05:52.903563 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-13ce1cfd-bb9f-46b7-946e-402d4a347129 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:52.904436 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-13ce1cfd-bb9f-46b7-946e-402d4a347129 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:52.911741 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13ce1cfd-bb9f-46b7-946e-402d4a347129 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:52.912617 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13ce1cfd-bb9f-46b7-946e-402d4a347129 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:52.913150 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13ce1cfd-bb9f-46b7-946e-402d4a347129 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:52.913947 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13ce1cfd-bb9f-46b7-946e-402d4a347129 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:52.914508 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13ce1cfd-bb9f-46b7-946e-402d4a347129 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:52.915023 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13ce1cfd-bb9f-46b7-946e-402d4a347129 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:53.150042 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-13ce1cfd-bb9f-46b7-946e-402d4a347129 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:53.157892 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-13ce1cfd-bb9f-46b7-946e-402d4a347129 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1522 microversion: 2.1 time: 0.259860 Sep 15 13:05:53.158552 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 317/641] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:52 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:53.637995 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-61ecfe3c-f280-4abf-9779-fccb652ea713 req-9090980a-ea5a-4095-ab9f-dad3c1f7f2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2628b91-c3d5-4bc0-88ed-c6786c051876", "name": "network-vif-unplugged", "status": "completed", "tag": "80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:53.661238 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-61ecfe3c-f280-4abf-9779-fccb652ea713 req-9090980a-ea5a-4095-ab9f-dad3c1f7f2b8 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:53.661860 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-61ecfe3c-f280-4abf-9779-fccb652ea713 req-9090980a-ea5a-4095-ab9f-dad3c1f7f2b8 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:53.662391 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-61ecfe3c-f280-4abf-9779-fccb652ea713 req-9090980a-ea5a-4095-ab9f-dad3c1f7f2b8 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:53.676225 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-61ecfe3c-f280-4abf-9779-fccb652ea713 req-9090980a-ea5a-4095-ab9f-dad3c1f7f2b8 service nova] Creating event network-vif-unplugged:80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80 for instance e2628b91-c3d5-4bc0-88ed-c6786c051876 on hv-cinder-83608 Sep 15 13:05:53.681778 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-61ecfe3c-f280-4abf-9779-fccb652ea713 req-9090980a-ea5a-4095-ab9f-dad3c1f7f2b8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049195 Sep 15 13:05:53.683032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 325/642] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:05:53.915491 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-309344067", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad7108c9-b096-48f6-8695-b73ac5e764c5"}], "security_groups": [{"name": "tempest-securitygroup--1356596200"}], "key_name": "tempest-keypair-1647303996", "user_data": "}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:54.017333 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.network.neutron [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] validate_networks() for [('ad7108c9-b096-48f6-8695-b73ac5e764c5', None, None, None, None, None)] {{(pid=120634) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:05:54.183007 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-fa0d1964-4762-4ccd-8cdb-ac1f046a1083 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:54.183714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-fa0d1964-4762-4ccd-8cdb-ac1f046a1083 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:54.190341 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fa0d1964-4762-4ccd-8cdb-ac1f046a1083 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:54.190831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fa0d1964-4762-4ccd-8cdb-ac1f046a1083 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:54.191854 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fa0d1964-4762-4ccd-8cdb-ac1f046a1083 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:54.192772 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fa0d1964-4762-4ccd-8cdb-ac1f046a1083 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:54.193147 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fa0d1964-4762-4ccd-8cdb-ac1f046a1083 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:54.193556 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fa0d1964-4762-4ccd-8cdb-ac1f046a1083 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:54.358887 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-fa0d1964-4762-4ccd-8cdb-ac1f046a1083 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:54.369632 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-fa0d1964-4762-4ccd-8cdb-ac1f046a1083 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.190685 Sep 15 13:05:54.370538 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 326/643] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:54 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:05:54.943233 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Flavor limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:05:54.943709 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Image limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:05:54.944101 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Flavor pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:05:54.944530 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Image pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:05:54.944933 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:05:54.953625 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:54.954099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:54.954528 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:54.955270 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:54.955713 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:54.956127 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:54.973273 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Getting quotas for project 27776e610cf84b49af0fec4b95aa31f3. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:05:54.977443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Getting quotas for user cff1145566f1408a9a22da9088581024 and project 27776e610cf84b49af0fec4b95aa31f3. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:05:54.988574 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Going to run 1 instances... {{(pid=120634) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:05:54.990779 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120634) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:05:55.038875 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-519e4098-6989-4be4-9740-757c7e9871e0 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.127585 Sep 15 13:05:55.039786 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 318/644] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:05:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 13:05:55.051983 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-881c4c1f-7537-46f4-8a28-d5921f8863e6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:55.052638 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-881c4c1f-7537-46f4-8a28-d5921f8863e6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:55.114140 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-881c4c1f-7537-46f4-8a28-d5921f8863e6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:55.121015 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-881c4c1f-7537-46f4-8a28-d5921f8863e6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1237 microversion: 2.1 time: 0.073889 Sep 15 13:05:55.122150 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 327/645] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:55 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:55.395765 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-9b00701f-3447-4606-ba85-e6b59910fe44 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:55.396414 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-9b00701f-3447-4606-ba85-e6b59910fe44 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:55.402406 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9b00701f-3447-4606-ba85-e6b59910fe44 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:55.402883 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9b00701f-3447-4606-ba85-e6b59910fe44 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:55.403313 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9b00701f-3447-4606-ba85-e6b59910fe44 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:55.404001 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9b00701f-3447-4606-ba85-e6b59910fe44 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:55.404481 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9b00701f-3447-4606-ba85-e6b59910fe44 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:55.404896 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9b00701f-3447-4606-ba85-e6b59910fe44 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:55.545960 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9b00701f-3447-4606-ba85-e6b59910fe44 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:55.554993 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-9b00701f-3447-4606-ba85-e6b59910fe44 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.163823 Sep 15 13:05:55.555561 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 319/646] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:55 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:56.145816 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e505ef55-1a95-4016-9882-f2b816547027 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:56.146464 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e505ef55-1a95-4016-9882-f2b816547027 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:56.153685 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e505ef55-1a95-4016-9882-f2b816547027 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:56.154179 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e505ef55-1a95-4016-9882-f2b816547027 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:56.154611 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e505ef55-1a95-4016-9882-f2b816547027 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:56.155325 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e505ef55-1a95-4016-9882-f2b816547027 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:56.155859 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e505ef55-1a95-4016-9882-f2b816547027 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:56.156307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e505ef55-1a95-4016-9882-f2b816547027 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:56.218884 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e505ef55-1a95-4016-9882-f2b816547027 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:56.228201 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e505ef55-1a95-4016-9882-f2b816547027 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1241 microversion: 2.1 time: 0.086522 Sep 15 13:05:56.228807 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 328/647] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:56 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:56.577986 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d2375c69-91a7-43ae-8545-00b35a8edd50 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:56.578591 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d2375c69-91a7-43ae-8545-00b35a8edd50 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:56.584629 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d2375c69-91a7-43ae-8545-00b35a8edd50 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:56.585107 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d2375c69-91a7-43ae-8545-00b35a8edd50 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:56.585535 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d2375c69-91a7-43ae-8545-00b35a8edd50 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:56.586210 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d2375c69-91a7-43ae-8545-00b35a8edd50 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:56.586654 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d2375c69-91a7-43ae-8545-00b35a8edd50 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:56.587070 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d2375c69-91a7-43ae-8545-00b35a8edd50 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:56.719745 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d2375c69-91a7-43ae-8545-00b35a8edd50 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:56.727460 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d2375c69-91a7-43ae-8545-00b35a8edd50 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.153314 Sep 15 13:05:56.728026 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 320/648] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:56 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:57.250949 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3ba3a6e1-8ef3-4b23-9728-6843c3b59f76 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:57.251559 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3ba3a6e1-8ef3-4b23-9728-6843c3b59f76 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:57.258564 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3ba3a6e1-8ef3-4b23-9728-6843c3b59f76 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:57.259331 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3ba3a6e1-8ef3-4b23-9728-6843c3b59f76 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:57.259767 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3ba3a6e1-8ef3-4b23-9728-6843c3b59f76 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:57.260527 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3ba3a6e1-8ef3-4b23-9728-6843c3b59f76 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:57.260964 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3ba3a6e1-8ef3-4b23-9728-6843c3b59f76 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:57.261384 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3ba3a6e1-8ef3-4b23-9728-6843c3b59f76 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:57.323295 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3ba3a6e1-8ef3-4b23-9728-6843c3b59f76 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:57.339476 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3ba3a6e1-8ef3-4b23-9728-6843c3b59f76 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1295 microversion: 2.1 time: 0.092304 Sep 15 13:05:57.340056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 329/649] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:57 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1295 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:57.750246 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-15a7d78d-6fe9-4624-9605-f20afe0124a6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:57.750959 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-15a7d78d-6fe9-4624-9605-f20afe0124a6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:57.758097 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-15a7d78d-6fe9-4624-9605-f20afe0124a6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:57.758625 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-15a7d78d-6fe9-4624-9605-f20afe0124a6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:57.759196 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-15a7d78d-6fe9-4624-9605-f20afe0124a6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:57.759778 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-15a7d78d-6fe9-4624-9605-f20afe0124a6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:57.760236 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-15a7d78d-6fe9-4624-9605-f20afe0124a6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:57.760695 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-15a7d78d-6fe9-4624-9605-f20afe0124a6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:58.013106 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-15a7d78d-6fe9-4624-9605-f20afe0124a6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:58.021883 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-15a7d78d-6fe9-4624-9605-f20afe0124a6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.275443 Sep 15 13:05:58.022736 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 321/650] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:57 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:58.362987 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-725df025-66e0-4fce-99d7-f4a50a9f69ef tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:58.363827 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-725df025-66e0-4fce-99d7-f4a50a9f69ef tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:58.370219 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-725df025-66e0-4fce-99d7-f4a50a9f69ef tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:58.370701 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-725df025-66e0-4fce-99d7-f4a50a9f69ef tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:58.371181 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-725df025-66e0-4fce-99d7-f4a50a9f69ef tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:58.371898 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-725df025-66e0-4fce-99d7-f4a50a9f69ef tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:58.372367 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-725df025-66e0-4fce-99d7-f4a50a9f69ef tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:58.372789 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-725df025-66e0-4fce-99d7-f4a50a9f69ef tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:58.505037 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-725df025-66e0-4fce-99d7-f4a50a9f69ef tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:58.512041 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-63e03493-d2a0-4a84-902c-febdd0d0895c req-22a09df2-527f-4c0f-8b7f-f65a11e291b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5890c2fe-0c31-40d0-a711-d783540d601c", "tag": "b747e91f-49be-4a75-ba8f-cd39089f132b"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:05:58.518089 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-725df025-66e0-4fce-99d7-f4a50a9f69ef tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1363 microversion: 2.1 time: 0.158895 Sep 15 13:05:58.518672 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 330/651] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:58 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:58.529002 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-63e03493-d2a0-4a84-902c-febdd0d0895c req-22a09df2-527f-4c0f-8b7f-f65a11e291b1 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:58.529568 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-63e03493-d2a0-4a84-902c-febdd0d0895c req-22a09df2-527f-4c0f-8b7f-f65a11e291b1 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:58.530346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-63e03493-d2a0-4a84-902c-febdd0d0895c req-22a09df2-527f-4c0f-8b7f-f65a11e291b1 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:58.545294 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-63e03493-d2a0-4a84-902c-febdd0d0895c req-22a09df2-527f-4c0f-8b7f-f65a11e291b1 service nova] Creating event network-changed:b747e91f-49be-4a75-ba8f-cd39089f132b for instance 5890c2fe-0c31-40d0-a711-d783540d601c on hv-cinder-83608 Sep 15 13:05:58.551152 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-63e03493-d2a0-4a84-902c-febdd0d0895c req-22a09df2-527f-4c0f-8b7f-f65a11e291b1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043700 Sep 15 13:05:58.552098 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 322/652] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:05:59.045723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-1720df6a-082f-4978-9160-bdc564320210 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:59.046344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-1720df6a-082f-4978-9160-bdc564320210 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:59.052991 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1720df6a-082f-4978-9160-bdc564320210 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:59.053472 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1720df6a-082f-4978-9160-bdc564320210 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:59.053906 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1720df6a-082f-4978-9160-bdc564320210 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:59.054596 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1720df6a-082f-4978-9160-bdc564320210 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:59.055048 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1720df6a-082f-4978-9160-bdc564320210 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:59.055477 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1720df6a-082f-4978-9160-bdc564320210 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:59.187286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-1720df6a-082f-4978-9160-bdc564320210 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:59.195429 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-1720df6a-082f-4978-9160-bdc564320210 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.153535 Sep 15 13:05:59.196008 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 331/653] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:59 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:05:59.541673 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b180c6e4-8bef-4865-bdbc-da0b18ec4d97 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:05:59.542374 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b180c6e4-8bef-4865-bdbc-da0b18ec4d97 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:05:59.548518 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b180c6e4-8bef-4865-bdbc-da0b18ec4d97 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:59.548992 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b180c6e4-8bef-4865-bdbc-da0b18ec4d97 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:59.549418 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b180c6e4-8bef-4865-bdbc-da0b18ec4d97 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:59.550627 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b180c6e4-8bef-4865-bdbc-da0b18ec4d97 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:05:59.551275 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b180c6e4-8bef-4865-bdbc-da0b18ec4d97 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:05:59.551744 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b180c6e4-8bef-4865-bdbc-da0b18ec4d97 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:05:59.682001 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b180c6e4-8bef-4865-bdbc-da0b18ec4d97 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:05:59.689617 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b180c6e4-8bef-4865-bdbc-da0b18ec4d97 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1363 microversion: 2.1 time: 0.152100 Sep 15 13:05:59.690186 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 323/654] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:05:59 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:00.218115 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c88cafb9-f268-476b-8009-8f4973d0b695 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:00.218730 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c88cafb9-f268-476b-8009-8f4973d0b695 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:00.225335 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c88cafb9-f268-476b-8009-8f4973d0b695 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:00.225815 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c88cafb9-f268-476b-8009-8f4973d0b695 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:00.226246 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c88cafb9-f268-476b-8009-8f4973d0b695 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:00.226931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c88cafb9-f268-476b-8009-8f4973d0b695 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:00.227383 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c88cafb9-f268-476b-8009-8f4973d0b695 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:00.227803 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c88cafb9-f268-476b-8009-8f4973d0b695 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:00.361206 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c88cafb9-f268-476b-8009-8f4973d0b695 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:00.369237 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c88cafb9-f268-476b-8009-8f4973d0b695 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.155106 Sep 15 13:06:00.369794 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 332/655] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:00 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:00.712781 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-dbb1fccb-2cf5-42a5-a59d-c34fbd06158e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:00.713489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-dbb1fccb-2cf5-42a5-a59d-c34fbd06158e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:00.719453 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dbb1fccb-2cf5-42a5-a59d-c34fbd06158e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:00.719888 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dbb1fccb-2cf5-42a5-a59d-c34fbd06158e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:00.720347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dbb1fccb-2cf5-42a5-a59d-c34fbd06158e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:00.721249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dbb1fccb-2cf5-42a5-a59d-c34fbd06158e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:00.721707 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dbb1fccb-2cf5-42a5-a59d-c34fbd06158e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:00.722767 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dbb1fccb-2cf5-42a5-a59d-c34fbd06158e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:00.851739 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-dbb1fccb-2cf5-42a5-a59d-c34fbd06158e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:00.865438 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-dbb1fccb-2cf5-42a5-a59d-c34fbd06158e tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1363 microversion: 2.1 time: 0.156411 Sep 15 13:06:00.866025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 324/656] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:00 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:01.391725 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-210ee3c9-e78c-41d9-bb4e-13b2472caebc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:01.392374 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-210ee3c9-e78c-41d9-bb4e-13b2472caebc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:01.395413 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:01.400894 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-210ee3c9-e78c-41d9-bb4e-13b2472caebc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:01.401372 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-210ee3c9-e78c-41d9-bb4e-13b2472caebc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:01.401818 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-210ee3c9-e78c-41d9-bb4e-13b2472caebc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:01.402510 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-210ee3c9-e78c-41d9-bb4e-13b2472caebc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:01.402953 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-210ee3c9-e78c-41d9-bb4e-13b2472caebc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:01.403368 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-210ee3c9-e78c-41d9-bb4e-13b2472caebc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:01.539025 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-210ee3c9-e78c-41d9-bb4e-13b2472caebc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:01.547294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-210ee3c9-e78c-41d9-bb4e-13b2472caebc tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.159363 Sep 15 13:06:01.560459 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 333/657] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:01 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:01.887438 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-9608513f-b4be-42ab-9187-290c3ee29ea5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:01.888045 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-9608513f-b4be-42ab-9187-290c3ee29ea5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:01.894426 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9608513f-b4be-42ab-9187-290c3ee29ea5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:01.894674 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9608513f-b4be-42ab-9187-290c3ee29ea5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:01.895562 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9608513f-b4be-42ab-9187-290c3ee29ea5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:01.896150 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9608513f-b4be-42ab-9187-290c3ee29ea5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:01.896631 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9608513f-b4be-42ab-9187-290c3ee29ea5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:01.897051 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9608513f-b4be-42ab-9187-290c3ee29ea5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:02.027715 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9608513f-b4be-42ab-9187-290c3ee29ea5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:02.036086 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-9608513f-b4be-42ab-9187-290c3ee29ea5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1363 microversion: 2.1 time: 0.152537 Sep 15 13:06:02.036683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 325/658] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:01 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:02.572034 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7c0054d1-dab0-441b-8190-be354189dd32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:02.572672 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7c0054d1-dab0-441b-8190-be354189dd32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:02.579173 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7c0054d1-dab0-441b-8190-be354189dd32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:02.579597 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7c0054d1-dab0-441b-8190-be354189dd32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:02.580026 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7c0054d1-dab0-441b-8190-be354189dd32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:02.580748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7c0054d1-dab0-441b-8190-be354189dd32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:02.581203 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7c0054d1-dab0-441b-8190-be354189dd32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:02.582230 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7c0054d1-dab0-441b-8190-be354189dd32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:02.713242 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7c0054d1-dab0-441b-8190-be354189dd32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:02.720940 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7c0054d1-dab0-441b-8190-be354189dd32 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.152809 Sep 15 13:06:02.721504 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 334/659] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:02 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:03.058830 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-823c69e4-c2ca-42d0-8268-9ef29f554d7f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:03.059437 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-823c69e4-c2ca-42d0-8268-9ef29f554d7f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:03.065311 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-823c69e4-c2ca-42d0-8268-9ef29f554d7f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:03.065858 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-823c69e4-c2ca-42d0-8268-9ef29f554d7f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:03.066369 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-823c69e4-c2ca-42d0-8268-9ef29f554d7f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:03.067059 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-823c69e4-c2ca-42d0-8268-9ef29f554d7f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:03.067505 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-823c69e4-c2ca-42d0-8268-9ef29f554d7f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:03.067920 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-823c69e4-c2ca-42d0-8268-9ef29f554d7f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:03.194814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-823c69e4-c2ca-42d0-8268-9ef29f554d7f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:03.202448 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-823c69e4-c2ca-42d0-8268-9ef29f554d7f tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1363 microversion: 2.1 time: 0.147477 Sep 15 13:06:03.203011 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 326/660] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:03 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:03.743639 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-37524230-56dd-4fa8-9f98-3813e1365aa7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:03.744241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-37524230-56dd-4fa8-9f98-3813e1365aa7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:03.750654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-37524230-56dd-4fa8-9f98-3813e1365aa7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:03.751134 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-37524230-56dd-4fa8-9f98-3813e1365aa7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:03.751567 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-37524230-56dd-4fa8-9f98-3813e1365aa7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:03.752254 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-37524230-56dd-4fa8-9f98-3813e1365aa7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:03.752735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-37524230-56dd-4fa8-9f98-3813e1365aa7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:03.753212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-37524230-56dd-4fa8-9f98-3813e1365aa7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:03.889438 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-37524230-56dd-4fa8-9f98-3813e1365aa7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:03.898147 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-37524230-56dd-4fa8-9f98-3813e1365aa7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.158411 Sep 15 13:06:03.898892 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 335/661] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:03 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:04.226409 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2f3fa3d6-ecaa-416b-a7a4-31a9c67365ab tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:04.227016 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2f3fa3d6-ecaa-416b-a7a4-31a9c67365ab tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:04.228967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:04.234125 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2f3fa3d6-ecaa-416b-a7a4-31a9c67365ab tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:04.234603 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2f3fa3d6-ecaa-416b-a7a4-31a9c67365ab tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:04.235032 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2f3fa3d6-ecaa-416b-a7a4-31a9c67365ab tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:04.235709 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2f3fa3d6-ecaa-416b-a7a4-31a9c67365ab tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:04.236157 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2f3fa3d6-ecaa-416b-a7a4-31a9c67365ab tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:04.236603 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2f3fa3d6-ecaa-416b-a7a4-31a9c67365ab tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:04.365027 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2f3fa3d6-ecaa-416b-a7a4-31a9c67365ab tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:04.368441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:04.373598 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2f3fa3d6-ecaa-416b-a7a4-31a9c67365ab tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1363 microversion: 2.1 time: 0.151893 Sep 15 13:06:04.374633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 327/662] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:04 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:04.920673 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-07223d11-58bd-4b8e-89be-6da606f935f4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:04.921287 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-07223d11-58bd-4b8e-89be-6da606f935f4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:04.927856 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-07223d11-58bd-4b8e-89be-6da606f935f4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:04.928366 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-07223d11-58bd-4b8e-89be-6da606f935f4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:04.928805 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-07223d11-58bd-4b8e-89be-6da606f935f4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:04.929491 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-07223d11-58bd-4b8e-89be-6da606f935f4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:04.929947 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-07223d11-58bd-4b8e-89be-6da606f935f4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:04.930371 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-07223d11-58bd-4b8e-89be-6da606f935f4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:04.948153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=100 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:05.063820 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-07223d11-58bd-4b8e-89be-6da606f935f4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:05.071598 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-07223d11-58bd-4b8e-89be-6da606f935f4 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.154696 Sep 15 13:06:05.072166 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 336/663] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:04 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:05.397695 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d812f11f-4843-43e2-8695-5c27d68b23ac tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:05.398376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d812f11f-4843-43e2-8695-5c27d68b23ac tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:05.400182 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:05.400877 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=6 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:05.407948 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d812f11f-4843-43e2-8695-5c27d68b23ac tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:05.408490 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d812f11f-4843-43e2-8695-5c27d68b23ac tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:05.408927 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d812f11f-4843-43e2-8695-5c27d68b23ac tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:05.409650 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d812f11f-4843-43e2-8695-5c27d68b23ac tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:05.410120 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d812f11f-4843-43e2-8695-5c27d68b23ac tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:05.410537 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d812f11f-4843-43e2-8695-5c27d68b23ac tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:05.543175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d812f11f-4843-43e2-8695-5c27d68b23ac tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:05.550742 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d812f11f-4843-43e2-8695-5c27d68b23ac tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1363 microversion: 2.1 time: 0.158439 Sep 15 13:06:05.551337 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 328/664] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:05 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:06.095420 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-858ac4c5-ee6a-4aa9-8a49-31b132c4d386 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:06.096705 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-858ac4c5-ee6a-4aa9-8a49-31b132c4d386 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:06.098649 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=6 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:06.104647 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-858ac4c5-ee6a-4aa9-8a49-31b132c4d386 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:06.105139 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-858ac4c5-ee6a-4aa9-8a49-31b132c4d386 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:06.105575 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-858ac4c5-ee6a-4aa9-8a49-31b132c4d386 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:06.106274 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-858ac4c5-ee6a-4aa9-8a49-31b132c4d386 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:06.106728 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-858ac4c5-ee6a-4aa9-8a49-31b132c4d386 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:06.107156 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-858ac4c5-ee6a-4aa9-8a49-31b132c4d386 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:06.238201 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-858ac4c5-ee6a-4aa9-8a49-31b132c4d386 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:06.245940 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-858ac4c5-ee6a-4aa9-8a49-31b132c4d386 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.154410 Sep 15 13:06:06.246516 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 337/665] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:06 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:06.574109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2273e0c5-787f-4d2c-a726-eb22b7a64370 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:06.574716 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2273e0c5-787f-4d2c-a726-eb22b7a64370 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:06.580611 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2273e0c5-787f-4d2c-a726-eb22b7a64370 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:06.581092 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2273e0c5-787f-4d2c-a726-eb22b7a64370 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:06.582068 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2273e0c5-787f-4d2c-a726-eb22b7a64370 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:06.582817 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2273e0c5-787f-4d2c-a726-eb22b7a64370 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:06.583263 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2273e0c5-787f-4d2c-a726-eb22b7a64370 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:06.583685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2273e0c5-787f-4d2c-a726-eb22b7a64370 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:06.710002 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2273e0c5-787f-4d2c-a726-eb22b7a64370 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:06.717534 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2273e0c5-787f-4d2c-a726-eb22b7a64370 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1363 microversion: 2.1 time: 0.147268 Sep 15 13:06:06.718095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 329/666] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:06 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:07.268410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b3163d7e-3cc5-4b65-a9d5-3654aabf1984 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:07.269655 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b3163d7e-3cc5-4b65-a9d5-3654aabf1984 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:07.276497 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b3163d7e-3cc5-4b65-a9d5-3654aabf1984 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:07.276978 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b3163d7e-3cc5-4b65-a9d5-3654aabf1984 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:07.277409 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b3163d7e-3cc5-4b65-a9d5-3654aabf1984 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:07.278088 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b3163d7e-3cc5-4b65-a9d5-3654aabf1984 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:07.278536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b3163d7e-3cc5-4b65-a9d5-3654aabf1984 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:07.278953 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b3163d7e-3cc5-4b65-a9d5-3654aabf1984 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:07.411489 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b3163d7e-3cc5-4b65-a9d5-3654aabf1984 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:07.419996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b3163d7e-3cc5-4b65-a9d5-3654aabf1984 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.155371 Sep 15 13:06:07.420665 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 338/667] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:07 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:07.741513 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3dd2c18d-c929-4036-84df-1085d8a09ef9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:07.742284 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3dd2c18d-c929-4036-84df-1085d8a09ef9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:07.748162 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3dd2c18d-c929-4036-84df-1085d8a09ef9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:07.748684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3dd2c18d-c929-4036-84df-1085d8a09ef9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:07.749118 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3dd2c18d-c929-4036-84df-1085d8a09ef9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:07.749815 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3dd2c18d-c929-4036-84df-1085d8a09ef9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:07.750272 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3dd2c18d-c929-4036-84df-1085d8a09ef9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:07.750694 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3dd2c18d-c929-4036-84df-1085d8a09ef9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:07.878004 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3dd2c18d-c929-4036-84df-1085d8a09ef9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:07.886239 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3dd2c18d-c929-4036-84df-1085d8a09ef9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1363 microversion: 2.1 time: 0.149168 Sep 15 13:06:07.886804 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 330/668] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:07 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:08.443416 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3129b1f5-23ed-48eb-8593-87f65f860c54 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:08.444002 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3129b1f5-23ed-48eb-8593-87f65f860c54 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:08.450471 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3129b1f5-23ed-48eb-8593-87f65f860c54 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:08.451400 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3129b1f5-23ed-48eb-8593-87f65f860c54 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:08.451400 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3129b1f5-23ed-48eb-8593-87f65f860c54 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:08.452063 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3129b1f5-23ed-48eb-8593-87f65f860c54 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:08.452540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3129b1f5-23ed-48eb-8593-87f65f860c54 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:08.452956 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3129b1f5-23ed-48eb-8593-87f65f860c54 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:08.584976 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3129b1f5-23ed-48eb-8593-87f65f860c54 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:08.592637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3129b1f5-23ed-48eb-8593-87f65f860c54 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.153666 Sep 15 13:06:08.593199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 339/669] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:08 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:08.909199 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1a8ea4c4-bdea-4c02-9497-91504f86d259 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:08.910334 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1a8ea4c4-bdea-4c02-9497-91504f86d259 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:08.915871 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a8ea4c4-bdea-4c02-9497-91504f86d259 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:08.916401 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a8ea4c4-bdea-4c02-9497-91504f86d259 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:08.916851 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a8ea4c4-bdea-4c02-9497-91504f86d259 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:08.917539 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a8ea4c4-bdea-4c02-9497-91504f86d259 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:08.917991 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a8ea4c4-bdea-4c02-9497-91504f86d259 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:08.918415 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a8ea4c4-bdea-4c02-9497-91504f86d259 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:09.049474 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1a8ea4c4-bdea-4c02-9497-91504f86d259 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:09.057163 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1a8ea4c4-bdea-4c02-9497-91504f86d259 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1363 microversion: 2.1 time: 0.151849 Sep 15 13:06:09.057751 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 331/670] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:08 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:09.616877 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-45bfafbd-e2be-44f6-9d62-0b9100472546 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:09.617488 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-45bfafbd-e2be-44f6-9d62-0b9100472546 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:09.623901 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-45bfafbd-e2be-44f6-9d62-0b9100472546 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:09.624413 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-45bfafbd-e2be-44f6-9d62-0b9100472546 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:09.624840 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-45bfafbd-e2be-44f6-9d62-0b9100472546 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:09.625523 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-45bfafbd-e2be-44f6-9d62-0b9100472546 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:09.625971 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-45bfafbd-e2be-44f6-9d62-0b9100472546 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:09.626386 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-45bfafbd-e2be-44f6-9d62-0b9100472546 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:09.763515 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-45bfafbd-e2be-44f6-9d62-0b9100472546 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:09.771766 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-45bfafbd-e2be-44f6-9d62-0b9100472546 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.159365 Sep 15 13:06:09.772345 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 340/671] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:09 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:06:10.079947 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-cef4fc13-405c-4bcb-983f-0d264b4f78c6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:10.080596 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-cef4fc13-405c-4bcb-983f-0d264b4f78c6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:10.087139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cef4fc13-405c-4bcb-983f-0d264b4f78c6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:10.087625 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cef4fc13-405c-4bcb-983f-0d264b4f78c6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:10.088061 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cef4fc13-405c-4bcb-983f-0d264b4f78c6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:10.088780 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cef4fc13-405c-4bcb-983f-0d264b4f78c6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:10.089238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cef4fc13-405c-4bcb-983f-0d264b4f78c6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:10.089664 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cef4fc13-405c-4bcb-983f-0d264b4f78c6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:10.216225 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-cef4fc13-405c-4bcb-983f-0d264b4f78c6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:10.224492 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-cef4fc13-405c-4bcb-983f-0d264b4f78c6 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1363 microversion: 2.1 time: 0.148316 Sep 15 13:06:10.225054 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 332/672] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:10 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:10.795088 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-463ab484-7270-4e5a-9b12-87b82c0c7349 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:10.795704 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-463ab484-7270-4e5a-9b12-87b82c0c7349 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:10.802178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-463ab484-7270-4e5a-9b12-87b82c0c7349 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:10.802663 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-463ab484-7270-4e5a-9b12-87b82c0c7349 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:10.803099 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-463ab484-7270-4e5a-9b12-87b82c0c7349 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:10.803794 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-463ab484-7270-4e5a-9b12-87b82c0c7349 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:10.804253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-463ab484-7270-4e5a-9b12-87b82c0c7349 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:10.804707 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-463ab484-7270-4e5a-9b12-87b82c0c7349 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:10.940359 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-463ab484-7270-4e5a-9b12-87b82c0c7349 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:10.949635 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-463ab484-7270-4e5a-9b12-87b82c0c7349 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.158450 Sep 15 13:06:10.950324 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 341/673] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:10 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:11.156202 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-157a9ebf-b652-43dc-a0b9-0c349f248470 req-9adea15f-4946-47b9-a0f9-3b8a8ae62c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5890c2fe-0c31-40d0-a711-d783540d601c", "name": "network-vif-plugged", "status": "completed", "tag": "b747e91f-49be-4a75-ba8f-cd39089f132b"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:06:11.168292 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-157a9ebf-b652-43dc-a0b9-0c349f248470 req-9adea15f-4946-47b9-a0f9-3b8a8ae62c20 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:11.168780 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-157a9ebf-b652-43dc-a0b9-0c349f248470 req-9adea15f-4946-47b9-a0f9-3b8a8ae62c20 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:11.169209 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-157a9ebf-b652-43dc-a0b9-0c349f248470 req-9adea15f-4946-47b9-a0f9-3b8a8ae62c20 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:11.181036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-157a9ebf-b652-43dc-a0b9-0c349f248470 req-9adea15f-4946-47b9-a0f9-3b8a8ae62c20 service nova] Creating event network-vif-plugged:b747e91f-49be-4a75-ba8f-cd39089f132b for instance 5890c2fe-0c31-40d0-a711-d783540d601c on hv-cinder-83608 Sep 15 13:06:11.186067 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-157a9ebf-b652-43dc-a0b9-0c349f248470 req-9adea15f-4946-47b9-a0f9-3b8a8ae62c20 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037640 Sep 15 13:06:11.186666 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 333/674] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:06:11.249158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-297af5c4-0555-4094-ae4a-b062c23ef61b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:11.249655 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-297af5c4-0555-4094-ae4a-b062c23ef61b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:11.260442 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-297af5c4-0555-4094-ae4a-b062c23ef61b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:11.261112 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-297af5c4-0555-4094-ae4a-b062c23ef61b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:11.261773 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-297af5c4-0555-4094-ae4a-b062c23ef61b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:11.262487 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-297af5c4-0555-4094-ae4a-b062c23ef61b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:11.262940 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-297af5c4-0555-4094-ae4a-b062c23ef61b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:11.263553 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-297af5c4-0555-4094-ae4a-b062c23ef61b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:11.409922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-297af5c4-0555-4094-ae4a-b062c23ef61b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:11.420155 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-297af5c4-0555-4094-ae4a-b062c23ef61b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1363 microversion: 2.1 time: 0.176602 Sep 15 13:06:11.424910 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 342/675] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:11 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:11.975221 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b8f75033-1c09-408b-a23f-3c9482bdbb6d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:11.976067 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b8f75033-1c09-408b-a23f-3c9482bdbb6d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:11.982549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b8f75033-1c09-408b-a23f-3c9482bdbb6d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:11.983063 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b8f75033-1c09-408b-a23f-3c9482bdbb6d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:11.983582 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b8f75033-1c09-408b-a23f-3c9482bdbb6d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:11.984581 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b8f75033-1c09-408b-a23f-3c9482bdbb6d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:11.985042 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b8f75033-1c09-408b-a23f-3c9482bdbb6d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:11.985467 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b8f75033-1c09-408b-a23f-3c9482bdbb6d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:12.131177 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b8f75033-1c09-408b-a23f-3c9482bdbb6d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:12.138872 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b8f75033-1c09-408b-a23f-3c9482bdbb6d tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.168700 Sep 15 13:06:12.139489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 334/676] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:11 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:12.443569 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-abf867a1-80de-44fa-b5e1-baa5be945202 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:12.444100 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-abf867a1-80de-44fa-b5e1-baa5be945202 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:12.450578 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-abf867a1-80de-44fa-b5e1-baa5be945202 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:12.451060 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-abf867a1-80de-44fa-b5e1-baa5be945202 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:12.451492 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-abf867a1-80de-44fa-b5e1-baa5be945202 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:12.452181 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-abf867a1-80de-44fa-b5e1-baa5be945202 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:12.452661 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-abf867a1-80de-44fa-b5e1-baa5be945202 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:12.453086 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-abf867a1-80de-44fa-b5e1-baa5be945202 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:12.586655 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-abf867a1-80de-44fa-b5e1-baa5be945202 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:12.594198 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-abf867a1-80de-44fa-b5e1-baa5be945202 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1363 microversion: 2.1 time: 0.155178 Sep 15 13:06:12.604677 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 343/677] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:12 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:13.164326 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ce29a365-7185-4efc-a65c-4c852b4955ad tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:13.165980 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ce29a365-7185-4efc-a65c-4c852b4955ad tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:13.173484 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ce29a365-7185-4efc-a65c-4c852b4955ad tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:13.174040 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ce29a365-7185-4efc-a65c-4c852b4955ad tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:13.174833 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ce29a365-7185-4efc-a65c-4c852b4955ad tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:13.177169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ce29a365-7185-4efc-a65c-4c852b4955ad tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:13.177910 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ce29a365-7185-4efc-a65c-4c852b4955ad tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:13.178434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ce29a365-7185-4efc-a65c-4c852b4955ad tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:13.218351 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-6f25eda1-2d4c-481d-bc29-f97f24b988fd req-ee87d9b4-042f-44c8-9d78-dd8d9e792972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2628b91-c3d5-4bc0-88ed-c6786c051876", "name": "network-vif-plugged", "status": "completed", "tag": "80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:06:13.227956 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-6f25eda1-2d4c-481d-bc29-f97f24b988fd req-ee87d9b4-042f-44c8-9d78-dd8d9e792972 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:13.228465 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-6f25eda1-2d4c-481d-bc29-f97f24b988fd req-ee87d9b4-042f-44c8-9d78-dd8d9e792972 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:13.228896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-6f25eda1-2d4c-481d-bc29-f97f24b988fd req-ee87d9b4-042f-44c8-9d78-dd8d9e792972 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:13.242048 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-6f25eda1-2d4c-481d-bc29-f97f24b988fd req-ee87d9b4-042f-44c8-9d78-dd8d9e792972 service nova] Creating event network-vif-plugged:80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80 for instance e2628b91-c3d5-4bc0-88ed-c6786c051876 on hv-cinder-83608 Sep 15 13:06:13.247397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-6f25eda1-2d4c-481d-bc29-f97f24b988fd req-ee87d9b4-042f-44c8-9d78-dd8d9e792972 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032893 Sep 15 13:06:13.248388 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 344/678] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:06:13.323305 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ce29a365-7185-4efc-a65c-4c852b4955ad tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:13.331135 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ce29a365-7185-4efc-a65c-4c852b4955ad tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.171875 Sep 15 13:06:13.332218 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 335/679] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:13 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:13.618953 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-dad35097-ee07-425a-9da6-ed81937a001b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:13.619571 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-dad35097-ee07-425a-9da6-ed81937a001b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:13.625714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dad35097-ee07-425a-9da6-ed81937a001b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:13.626201 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dad35097-ee07-425a-9da6-ed81937a001b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:13.626624 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dad35097-ee07-425a-9da6-ed81937a001b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:13.627308 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dad35097-ee07-425a-9da6-ed81937a001b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:13.627761 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dad35097-ee07-425a-9da6-ed81937a001b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:13.628707 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dad35097-ee07-425a-9da6-ed81937a001b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:13.762029 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-dad35097-ee07-425a-9da6-ed81937a001b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:13.770383 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-dad35097-ee07-425a-9da6-ed81937a001b tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1547 microversion: 2.1 time: 0.155925 Sep 15 13:06:13.770953 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 345/680] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:13 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:06:13.792585 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d167a253-36d6-4eb6-9340-e3947efd81cb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:13.793073 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d167a253-36d6-4eb6-9340-e3947efd81cb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:13.798989 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d167a253-36d6-4eb6-9340-e3947efd81cb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:13.799468 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d167a253-36d6-4eb6-9340-e3947efd81cb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:13.799900 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d167a253-36d6-4eb6-9340-e3947efd81cb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:13.801376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d167a253-36d6-4eb6-9340-e3947efd81cb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:13.801822 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d167a253-36d6-4eb6-9340-e3947efd81cb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:13.802243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d167a253-36d6-4eb6-9340-e3947efd81cb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:13.890503 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d167a253-36d6-4eb6-9340-e3947efd81cb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101732 Sep 15 13:06:13.891217 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 336/681] 10.222.0.57 () {58 vars in 1275 bytes} [Thu Sep 15 13:06:13 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:06:14.355088 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-6084c9c9-c0a3-4df7-b438-2d6f8ec2102e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:14.355821 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-6084c9c9-c0a3-4df7-b438-2d6f8ec2102e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:14.361790 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6084c9c9-c0a3-4df7-b438-2d6f8ec2102e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:14.362358 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6084c9c9-c0a3-4df7-b438-2d6f8ec2102e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:14.363385 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6084c9c9-c0a3-4df7-b438-2d6f8ec2102e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:14.364087 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6084c9c9-c0a3-4df7-b438-2d6f8ec2102e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:14.364579 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6084c9c9-c0a3-4df7-b438-2d6f8ec2102e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:14.365012 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6084c9c9-c0a3-4df7-b438-2d6f8ec2102e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:14.503668 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-6084c9c9-c0a3-4df7-b438-2d6f8ec2102e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:14.511457 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-6084c9c9-c0a3-4df7-b438-2d6f8ec2102e tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1578 microversion: 2.1 time: 0.160389 Sep 15 13:06:14.512029 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 346/682] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:14 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:15.164768 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-39494402-7bba-45ec-b661-cbbe59f79a61 req-9f07301f-299c-4e2d-ad37-395787140e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5890c2fe-0c31-40d0-a711-d783540d601c", "tag": "b747e91f-49be-4a75-ba8f-cd39089f132b"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:06:15.176671 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-39494402-7bba-45ec-b661-cbbe59f79a61 req-9f07301f-299c-4e2d-ad37-395787140e99 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:15.177220 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-39494402-7bba-45ec-b661-cbbe59f79a61 req-9f07301f-299c-4e2d-ad37-395787140e99 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:15.177875 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-39494402-7bba-45ec-b661-cbbe59f79a61 req-9f07301f-299c-4e2d-ad37-395787140e99 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:15.189431 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-39494402-7bba-45ec-b661-cbbe59f79a61 req-9f07301f-299c-4e2d-ad37-395787140e99 service nova] Creating event network-changed:b747e91f-49be-4a75-ba8f-cd39089f132b for instance 5890c2fe-0c31-40d0-a711-d783540d601c on hv-cinder-83608 Sep 15 13:06:15.195145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-39494402-7bba-45ec-b661-cbbe59f79a61 req-9f07301f-299c-4e2d-ad37-395787140e99 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033846 Sep 15 13:06:15.195870 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 337/683] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:06:15.597322 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0eb833cb-4123-41a9-80d1-0b50f7ec5352 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:15.598040 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0eb833cb-4123-41a9-80d1-0b50f7ec5352 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:15.605618 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0eb833cb-4123-41a9-80d1-0b50f7ec5352 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:15.606230 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0eb833cb-4123-41a9-80d1-0b50f7ec5352 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:15.606651 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0eb833cb-4123-41a9-80d1-0b50f7ec5352 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:15.607414 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0eb833cb-4123-41a9-80d1-0b50f7ec5352 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:15.607868 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0eb833cb-4123-41a9-80d1-0b50f7ec5352 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:15.608331 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0eb833cb-4123-41a9-80d1-0b50f7ec5352 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:15.744815 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0eb833cb-4123-41a9-80d1-0b50f7ec5352 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:15.752697 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0eb833cb-4123-41a9-80d1-0b50f7ec5352 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1565 microversion: 2.1 time: 0.160916 Sep 15 13:06:15.753392 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 347/684] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:15 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:35.151388 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=21 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:35.156870 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=50 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:35.157469 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a53fdc0b-16e5-46b7-bc2d-e8f4b794a5f1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:35.158047 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a53fdc0b-16e5-46b7-bc2d-e8f4b794a5f1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:35.164911 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a53fdc0b-16e5-46b7-bc2d-e8f4b794a5f1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:35.165386 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a53fdc0b-16e5-46b7-bc2d-e8f4b794a5f1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:35.165813 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a53fdc0b-16e5-46b7-bc2d-e8f4b794a5f1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:35.166490 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a53fdc0b-16e5-46b7-bc2d-e8f4b794a5f1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:35.166938 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a53fdc0b-16e5-46b7-bc2d-e8f4b794a5f1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:35.167352 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a53fdc0b-16e5-46b7-bc2d-e8f4b794a5f1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:35.190102 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a53fdc0b-16e5-46b7-bc2d-e8f4b794a5f1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/ips" status: 200 len: 150 microversion: 2.1 time: 0.039952 Sep 15 13:06:35.190668 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 338/685] 10.222.0.57 () {58 vars in 1248 bytes} [Thu Sep 15 13:06:35 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:06:36.519001 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-33ea0d0e-4cdb-4e3e-b9e2-ec46972e1611 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16ac9a40-dcf8-41ca-8171-9655529e7e69"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:06:36.522828 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-33ea0d0e-4cdb-4e3e-b9e2-ec46972e1611 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:36.525250 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=29 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:36.526057 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=64 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:36.532036 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-33ea0d0e-4cdb-4e3e-b9e2-ec46972e1611 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:36.532551 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-33ea0d0e-4cdb-4e3e-b9e2-ec46972e1611 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:36.532984 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-33ea0d0e-4cdb-4e3e-b9e2-ec46972e1611 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:36.533677 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-33ea0d0e-4cdb-4e3e-b9e2-ec46972e1611 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:36.534131 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-33ea0d0e-4cdb-4e3e-b9e2-ec46972e1611 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:36.534556 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-33ea0d0e-4cdb-4e3e-b9e2-ec46972e1611 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:36.799387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-33ea0d0e-4cdb-4e3e-b9e2-ec46972e1611 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "POST /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284439 Sep 15 13:06:36.800081 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 348/686] 10.222.0.57 () {60 vars in 1323 bytes} [Thu Sep 15 13:06:36 2022] POST /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:06:44.365371 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4534055b-2ad9-4f02-93ee-7aa32adcafb5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16ac9a40-dcf8-41ca-8171-9655529e7e69"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:06:44.368789 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-4534055b-2ad9-4f02-93ee-7aa32adcafb5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:44.375648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4534055b-2ad9-4f02-93ee-7aa32adcafb5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:44.376131 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4534055b-2ad9-4f02-93ee-7aa32adcafb5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:44.376749 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4534055b-2ad9-4f02-93ee-7aa32adcafb5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:44.378130 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4534055b-2ad9-4f02-93ee-7aa32adcafb5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:44.378738 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4534055b-2ad9-4f02-93ee-7aa32adcafb5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:44.379327 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4534055b-2ad9-4f02-93ee-7aa32adcafb5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:44.475455 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-4534055b-2ad9-4f02-93ee-7aa32adcafb5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] HTTP exception thrown: Invalid volume: volume 16ac9a40-dcf8-41ca-8171-9655529e7e69 is already attached to instances: d28efcba-b6d3-4758-b3ea-de3992bc888a Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4534055b-2ad9-4f02-93ee-7aa32adcafb5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Request method failure captured: Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: POST /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/os-volume_attachments HTTP/1.1 Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 74 Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyF7i7azu69ujLWg4VmTaNmO_zlpZPMUNTZrbMEnkSIYxAt8-6t89_4emnOqEbXOd0vYTcUpuPUNe1odpy6Z_A42YWyOg_xfXoVm1614XjjnNtx-GDPzKOh0QDXFBzLzkRmidRDvMrs8mjeXHDo1r_RSCgjMCh8MlbrqEaex6H5lClc Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:06:44.477998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:06:44.479361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e4c4dc894bd429b8f46ae444eb5ff7d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}] Sep 15 13:06:44.479361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:06:44.479361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:06:44.479361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:06:44.479361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:06:44.479361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:06:44.479361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:06:44.479361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: cd22d2df9ced4bb0961596385854422d Sep 15 13:06:44.479361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:06:44.479361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Sep 15 13:06:44.479361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {"volumeAttachment": {"volumeId": "16ac9a40-dcf8-41ca-8171-9655529e7e69"}} Sep 15 13:06:44.479361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Invalid volume: volume 16ac9a40-dcf8-41ca-8171-9655529e7e69 is already attached to instances: d28efcba-b6d3-4758-b3ea-de3992bc888a Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'server_id': 'd28efcba-b6d3-4758-b3ea-de3992bc888a', 'body': {'volumeAttachment': {'volumeId': '16ac9a40-dcf8-41ca-8171-9655529e7e69'}}} Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 16ac9a40-dcf8-41ca-8171-9655529e7e69 is already attached to instances: d28efcba-b6d3-4758-b3ea-de3992bc888a Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:06:44.480109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 16ac9a40-dcf8-41ca-8171-9655529e7e69 is already attached to instances: d28efcba-b6d3-4758-b3ea-de3992bc888a Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:06:44.481984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:06:44.483236 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:06:44.483236 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:06:44.483236 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:06:44.483236 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 16ac9a40-dcf8-41ca-8171-9655529e7e69 is already attached to instances: d28efcba-b6d3-4758-b3ea-de3992bc888a Sep 15 13:06:44.483236 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:06:44.483236 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4534055b-2ad9-4f02-93ee-7aa32adcafb5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Returning 400 to user: Invalid volume: volume 16ac9a40-dcf8-41ca-8171-9655529e7e69 is already attached to instances: d28efcba-b6d3-4758-b3ea-de3992bc888a {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:06:44.483236 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-4534055b-2ad9-4f02-93ee-7aa32adcafb5 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "POST /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118555 Sep 15 13:06:44.484010 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 339/687] 10.222.0.57 () {60 vars in 1323 bytes} [Thu Sep 15 13:06:44 2022] POST /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 13:06:44.557199 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cb8a05f3-5e53-4a1d-9d88-9d4a9648ae87 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:44.557868 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cb8a05f3-5e53-4a1d-9d88-9d4a9648ae87 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:44.564099 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cb8a05f3-5e53-4a1d-9d88-9d4a9648ae87 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:44.564686 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cb8a05f3-5e53-4a1d-9d88-9d4a9648ae87 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:44.565236 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cb8a05f3-5e53-4a1d-9d88-9d4a9648ae87 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:44.566087 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cb8a05f3-5e53-4a1d-9d88-9d4a9648ae87 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:44.566712 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cb8a05f3-5e53-4a1d-9d88-9d4a9648ae87 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:44.567207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cb8a05f3-5e53-4a1d-9d88-9d4a9648ae87 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:44.652769 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-cb8a05f3-5e53-4a1d-9d88-9d4a9648ae87 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lazy-loading 'services' on Instance uuid d28efcba-b6d3-4758-b3ea-de3992bc888a {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:06:44.728982 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cb8a05f3-5e53-4a1d-9d88-9d4a9648ae87 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/os-volume_attachments/16ac9a40-dcf8-41ca-8171-9655529e7e69" status: 202 len: 0 microversion: 2.1 time: 0.177486 Sep 15 13:06:44.729574 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 349/688] 10.222.0.57 () {58 vars in 1416 bytes} [Thu Sep 15 13:06:44 2022] DELETE /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/os-volume_attachments/16ac9a40-dcf8-41ca-8171-9655529e7e69 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:06:44.737831 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-89cbaa9b-ca53-41d3-ac1b-06171950e23c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:44.740074 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-89cbaa9b-ca53-41d3-ac1b-06171950e23c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:44.747147 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89cbaa9b-ca53-41d3-ac1b-06171950e23c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:44.747643 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89cbaa9b-ca53-41d3-ac1b-06171950e23c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:44.748081 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89cbaa9b-ca53-41d3-ac1b-06171950e23c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:44.748850 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89cbaa9b-ca53-41d3-ac1b-06171950e23c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:44.749268 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89cbaa9b-ca53-41d3-ac1b-06171950e23c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:44.749694 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89cbaa9b-ca53-41d3-ac1b-06171950e23c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:44.781587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-89cbaa9b-ca53-41d3-ac1b-06171950e23c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047514 Sep 15 13:06:44.782938 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 340/689] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:06:44 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:06:45.797312 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-1e05ab66-7bf6-4435-a121-dc7e4742ee4a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:45.800459 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-1e05ab66-7bf6-4435-a121-dc7e4742ee4a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:45.809215 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1e05ab66-7bf6-4435-a121-dc7e4742ee4a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:45.810210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1e05ab66-7bf6-4435-a121-dc7e4742ee4a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:45.810876 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1e05ab66-7bf6-4435-a121-dc7e4742ee4a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:45.811815 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1e05ab66-7bf6-4435-a121-dc7e4742ee4a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:45.812655 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1e05ab66-7bf6-4435-a121-dc7e4742ee4a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:45.813023 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1e05ab66-7bf6-4435-a121-dc7e4742ee4a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:45.849907 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-1e05ab66-7bf6-4435-a121-dc7e4742ee4a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058210 Sep 15 13:06:45.850907 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 350/690] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:06:45 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 13:06:45.918485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3e501f0b-0648-4146-a5fe-b87ee9f32060 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:45.919019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3e501f0b-0648-4146-a5fe-b87ee9f32060 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:45.925375 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3e501f0b-0648-4146-a5fe-b87ee9f32060 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:45.925865 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3e501f0b-0648-4146-a5fe-b87ee9f32060 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:45.926293 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3e501f0b-0648-4146-a5fe-b87ee9f32060 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:45.927181 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3e501f0b-0648-4146-a5fe-b87ee9f32060 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:45.927635 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3e501f0b-0648-4146-a5fe-b87ee9f32060 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:45.928058 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3e501f0b-0648-4146-a5fe-b87ee9f32060 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:45.953652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3e501f0b-0648-4146-a5fe-b87ee9f32060 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Going to try to terminate instance {{(pid=120634) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:06:46.046144 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3e501f0b-0648-4146-a5fe-b87ee9f32060 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 204 len: 0 microversion: 2.1 time: 0.131135 Sep 15 13:06:46.046879 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 341/691] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:06:45 2022] DELETE /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:06:46.055411 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-270b38dc-0dfa-4590-b619-dd09571b81e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:46.056121 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-270b38dc-0dfa-4590-b619-dd09571b81e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:46.062495 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-270b38dc-0dfa-4590-b619-dd09571b81e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:46.063136 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-270b38dc-0dfa-4590-b619-dd09571b81e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:46.063774 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-270b38dc-0dfa-4590-b619-dd09571b81e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:46.064665 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-270b38dc-0dfa-4590-b619-dd09571b81e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:46.065122 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-270b38dc-0dfa-4590-b619-dd09571b81e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:46.066166 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-270b38dc-0dfa-4590-b619-dd09571b81e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:46.201346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-270b38dc-0dfa-4590-b619-dd09571b81e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:46.209018 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-270b38dc-0dfa-4590-b619-dd09571b81e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1680 microversion: 2.1 time: 0.157919 Sep 15 13:06:46.209583 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 351/692] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:46 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:06:47.233452 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-46a3c45d-1bd9-414a-8e3d-fe6f5a594f23 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:47.234149 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-46a3c45d-1bd9-414a-8e3d-fe6f5a594f23 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:47.240029 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-46a3c45d-1bd9-414a-8e3d-fe6f5a594f23 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:47.240545 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-46a3c45d-1bd9-414a-8e3d-fe6f5a594f23 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:47.241125 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-46a3c45d-1bd9-414a-8e3d-fe6f5a594f23 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:47.242429 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-46a3c45d-1bd9-414a-8e3d-fe6f5a594f23 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:47.242884 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-46a3c45d-1bd9-414a-8e3d-fe6f5a594f23 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:47.243310 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-46a3c45d-1bd9-414a-8e3d-fe6f5a594f23 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:47.392404 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-46a3c45d-1bd9-414a-8e3d-fe6f5a594f23 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:47.401109 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-46a3c45d-1bd9-414a-8e3d-fe6f5a594f23 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1680 microversion: 2.1 time: 0.171582 Sep 15 13:06:47.401686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 342/693] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:47 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:48.425052 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-afd12111-18c3-4404-a70a-29af4f036912 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:48.425736 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-afd12111-18c3-4404-a70a-29af4f036912 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:48.432638 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-afd12111-18c3-4404-a70a-29af4f036912 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:48.433195 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-afd12111-18c3-4404-a70a-29af4f036912 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:48.433637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-afd12111-18c3-4404-a70a-29af4f036912 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:48.434371 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-afd12111-18c3-4404-a70a-29af4f036912 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:48.434830 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-afd12111-18c3-4404-a70a-29af4f036912 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:48.435259 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-afd12111-18c3-4404-a70a-29af4f036912 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:48.571998 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-afd12111-18c3-4404-a70a-29af4f036912 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:48.581419 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-afd12111-18c3-4404-a70a-29af4f036912 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1680 microversion: 2.1 time: 0.160225 Sep 15 13:06:48.582475 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 352/694] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:48 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:49.325907 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-746967bb-1c89-44cc-970a-f0942bb6f5f8 req-d8e239e4-4add-4fbf-ba6f-641b5f2701a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28efcba-b6d3-4758-b3ea-de3992bc888a", "name": "network-vif-deleted", "tag": "a943f44d-916a-4082-948c-693f4078378e"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:06:49.341079 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-746967bb-1c89-44cc-970a-f0942bb6f5f8 req-d8e239e4-4add-4fbf-ba6f-641b5f2701a1 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:49.341631 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-746967bb-1c89-44cc-970a-f0942bb6f5f8 req-d8e239e4-4add-4fbf-ba6f-641b5f2701a1 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:49.342252 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-746967bb-1c89-44cc-970a-f0942bb6f5f8 req-d8e239e4-4add-4fbf-ba6f-641b5f2701a1 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:49.363918 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-746967bb-1c89-44cc-970a-f0942bb6f5f8 req-d8e239e4-4add-4fbf-ba6f-641b5f2701a1 service nova] Creating event network-vif-deleted:a943f44d-916a-4082-948c-693f4078378e for instance d28efcba-b6d3-4758-b3ea-de3992bc888a on hv-cinder-83608 Sep 15 13:06:49.374265 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-746967bb-1c89-44cc-970a-f0942bb6f5f8 req-d8e239e4-4add-4fbf-ba6f-641b5f2701a1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054484 Sep 15 13:06:49.375242 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 343/695] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:06:49.605359 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e793ad2d-b1ed-43ab-8070-9930a65d6329 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:49.605993 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e793ad2d-b1ed-43ab-8070-9930a65d6329 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:49.613204 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e793ad2d-b1ed-43ab-8070-9930a65d6329 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:49.614384 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e793ad2d-b1ed-43ab-8070-9930a65d6329 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:49.614842 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e793ad2d-b1ed-43ab-8070-9930a65d6329 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:49.615692 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e793ad2d-b1ed-43ab-8070-9930a65d6329 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:49.619027 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e793ad2d-b1ed-43ab-8070-9930a65d6329 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:49.619683 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e793ad2d-b1ed-43ab-8070-9930a65d6329 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:49.661724 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e793ad2d-b1ed-43ab-8070-9930a65d6329 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:49.662877 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e793ad2d-b1ed-43ab-8070-9930a65d6329 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:49.665262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e793ad2d-b1ed-43ab-8070-9930a65d6329 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:49.666302 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-e793ad2d-b1ed-43ab-8070-9930a65d6329 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lazy-loading 'fault' on Instance uuid d28efcba-b6d3-4758-b3ea-de3992bc888a {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:06:49.716226 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e793ad2d-b1ed-43ab-8070-9930a65d6329 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:49.724332 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e793ad2d-b1ed-43ab-8070-9930a65d6329 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 200 len: 1330 microversion: 2.1 time: 0.122879 Sep 15 13:06:49.725137 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 353/696] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:49 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 1330 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:50.748045 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-028f8da7-737c-4c19-85e9-e46d37ca5164 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:50.748779 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-028f8da7-737c-4c19-85e9-e46d37ca5164 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:50.754791 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-028f8da7-737c-4c19-85e9-e46d37ca5164 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:50.755271 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-028f8da7-737c-4c19-85e9-e46d37ca5164 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:50.755709 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-028f8da7-737c-4c19-85e9-e46d37ca5164 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:50.756432 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-028f8da7-737c-4c19-85e9-e46d37ca5164 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:50.757020 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-028f8da7-737c-4c19-85e9-e46d37ca5164 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:50.757452 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-028f8da7-737c-4c19-85e9-e46d37ca5164 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:50.770925 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-028f8da7-737c-4c19-85e9-e46d37ca5164 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] HTTP exception thrown: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-028f8da7-737c-4c19-85e9-e46d37ca5164 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Request method failure captured: Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a HTTP/1.1 Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyF7i7azu69ujLWg4VmTaNmO_zlpZPMUNTZrbMEnkSIYxAt8-6t89_4emnOqEbXOd0vYTcUpuPUNe1odpy6Z_A42YWyOg_xfXoVm1614XjjnNtx-GDPzKOh0QDXFBzLzkRmidRDvMrs8mjeXHDo1r_RSCgjMCh8MlbrqEaex6H5lClc Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:06:50.772750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:06:50.774249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e4c4dc894bd429b8f46ae444eb5ff7d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}] Sep 15 13:06:50.774249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:06:50.774249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:06:50.774249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:06:50.774249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:06:50.774249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:06:50.774249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:06:50.774249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: cd22d2df9ced4bb0961596385854422d Sep 15 13:06:50.774249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:06:50.774249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:06:50.774249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:06:50.774249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': 'd28efcba-b6d3-4758-b3ea-de3992bc888a'} Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:06:50.775069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:06:50.776261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:06:50.777411 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-028f8da7-737c-4c19-85e9-e46d37ca5164 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Returning 404 to user: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:06:50.777411 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-028f8da7-737c-4c19-85e9-e46d37ca5164 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 404 len: 111 microversion: 2.1 time: 0.030378 Sep 15 13:06:50.777411 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 344/697] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:50 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:06:50.783081 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e6e988c3-6cf2-49d4-888a-47f557808850 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '.version_select at 0x7f62c5491280>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:50.802226 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e6e988c3-6cf2-49d4-888a-47f557808850 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-940171364" status: 202 len: 0 microversion: 2.1 time: 0.022752 Sep 15 13:06:50.802821 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 354/698] 10.222.0.57 () {58 vars in 1218 bytes} [Thu Sep 15 13:06:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-940171364 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 13:06:51.425359 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a834d4c4-aaa1-4c81-93d7-9a1c014734e1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Action: 'create', calling method: .version_select at 0x7f62c55ecdc0>, body: {"keypair": {"name": "tempest-keypair-1598014885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbmAB5JdUVd8foA/e0WJS+aXDIC76ZOe+Z0RNwX2ffLtfo+1wda0dPklF/AhSSiItIkELh1Oq7zmV/eaHH7PLbENs3YZwIevztySNfwWweHZtMD38pRJhCmm6pVnhlmyQ=="}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:06:51.441189 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-a834d4c4-aaa1-4c81-93d7-9a1c014734e1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'key_pairs'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:06:51.445014 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-a834d4c4-aaa1-4c81-93d7-9a1c014734e1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for user cd22d2df9ced4bb0961596385854422d and project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'key_pairs'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:06:51.467095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a834d4c4-aaa1-4c81-93d7-9a1c014734e1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045673 Sep 15 13:06:51.467676 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 345/699] 10.222.0.57 () {60 vars in 1159 bytes} [Thu Sep 15 13:06:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:06:52.692661 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-98d0de0b-6b8c-4622-998f-56013296909d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:52.693267 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-98d0de0b-6b8c-4622-998f-56013296909d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:52.700846 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-98d0de0b-6b8c-4622-998f-56013296909d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:52.701320 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-98d0de0b-6b8c-4622-998f-56013296909d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:52.701757 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-98d0de0b-6b8c-4622-998f-56013296909d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:52.702464 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-98d0de0b-6b8c-4622-998f-56013296909d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:52.702924 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-98d0de0b-6b8c-4622-998f-56013296909d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:52.703356 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-98d0de0b-6b8c-4622-998f-56013296909d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:52.727018 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-98d0de0b-6b8c-4622-998f-56013296909d tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae/ips" status: 200 len: 152 microversion: 2.20 time: 0.038754 Sep 15 13:06:52.727598 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 355/700] 10.222.0.57 () {60 vars in 1289 bytes} [Thu Sep 15 13:06:52 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 13:06:52.756427 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-256210187", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0e4d116-b42c-4d92-83e5-69793b91ec95"}], "security_groups": [{"name": "tempest-securitygroup--323791509"}], "key_name": "tempest-keypair-1598014885", "user_data": "}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:06:52.863706 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.network.neutron [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] validate_networks() for [('e0e4d116-b42c-4d92-83e5-69793b91ec95', None, None, None, None, None)] {{(pid=120634) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:06:53.249062 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Flavor limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:06:53.249503 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Image limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:06:53.250008 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Flavor pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:06:53.250619 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Image pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:06:53.250846 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:06:53.259956 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:53.260474 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:53.260909 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:53.261653 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:53.262103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:53.262530 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:53.279672 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:06:53.283607 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Getting quotas for user cd22d2df9ced4bb0961596385854422d and project 2e4c4dc894bd429b8f46ae444eb5ff7d. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:06:53.295181 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Going to run 1 instances... {{(pid=120634) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:06:53.297497 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120634) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:06:53.343675 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-913702f8-0658-478d-a9cf-624f763a10ce tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.591479 Sep 15 13:06:53.344215 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 346/701] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:06:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 13:06:53.356403 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-25d64c82-a195-4918-a096-b24599b41d81 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:53.357016 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-25d64c82-a195-4918-a096-b24599b41d81 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:53.414177 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-25d64c82-a195-4918-a096-b24599b41d81 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:53.421057 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-25d64c82-a195-4918-a096-b24599b41d81 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1241 microversion: 2.1 time: 0.068487 Sep 15 13:06:53.421684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 356/702] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:53 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:54.443087 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d40b31c6-2f7e-4029-9009-42bb0564a251 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:54.443612 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d40b31c6-2f7e-4029-9009-42bb0564a251 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:54.451225 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d40b31c6-2f7e-4029-9009-42bb0564a251 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:54.451704 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d40b31c6-2f7e-4029-9009-42bb0564a251 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:54.452136 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d40b31c6-2f7e-4029-9009-42bb0564a251 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:54.453053 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d40b31c6-2f7e-4029-9009-42bb0564a251 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:54.453581 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d40b31c6-2f7e-4029-9009-42bb0564a251 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:54.454158 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d40b31c6-2f7e-4029-9009-42bb0564a251 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:54.531452 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d40b31c6-2f7e-4029-9009-42bb0564a251 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:54.541548 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d40b31c6-2f7e-4029-9009-42bb0564a251 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1301 microversion: 2.1 time: 0.101563 Sep 15 13:06:54.541548 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 347/703] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:54 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1301 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:55.423338 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-aac0adfa-be15-4121-8453-3f48164990be tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:06:55.423922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-aac0adfa-be15-4121-8453-3f48164990be tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:55.430950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aac0adfa-be15-4121-8453-3f48164990be tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:55.431439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aac0adfa-be15-4121-8453-3f48164990be tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:55.431874 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aac0adfa-be15-4121-8453-3f48164990be tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:55.432600 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aac0adfa-be15-4121-8453-3f48164990be tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:55.433056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aac0adfa-be15-4121-8453-3f48164990be tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:55.433478 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aac0adfa-be15-4121-8453-3f48164990be tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:55.464231 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-aac0adfa-be15-4121-8453-3f48164990be tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lazy-loading 'flavor' on Instance uuid 8f141686-0b27-4fd1-9e23-6634ade717ae {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:06:55.563098 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c3117365-416d-4e5b-8237-cdbd0f3c84b8 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:55.563912 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c3117365-416d-4e5b-8237-cdbd0f3c84b8 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:55.570154 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c3117365-416d-4e5b-8237-cdbd0f3c84b8 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:55.572357 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c3117365-416d-4e5b-8237-cdbd0f3c84b8 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:55.573246 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c3117365-416d-4e5b-8237-cdbd0f3c84b8 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:55.574110 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c3117365-416d-4e5b-8237-cdbd0f3c84b8 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:55.575084 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c3117365-416d-4e5b-8237-cdbd0f3c84b8 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:55.575522 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c3117365-416d-4e5b-8237-cdbd0f3c84b8 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:55.708623 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-aac0adfa-be15-4121-8453-3f48164990be tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "POST /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae/action" status: 202 len: 0 microversion: 2.20 time: 0.288460 Sep 15 13:06:55.709388 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 357/704] 10.222.0.57 () {62 vars in 1319 bytes} [Thu Sep 15 13:06:55 2022] POST /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 15 13:06:55.721128 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-fab94652-643c-405f-b540-2d3723fef9ee tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:55.722167 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-fab94652-643c-405f-b540-2d3723fef9ee tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:55.731115 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fab94652-643c-405f-b540-2d3723fef9ee tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:55.732072 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fab94652-643c-405f-b540-2d3723fef9ee tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:55.732577 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fab94652-643c-405f-b540-2d3723fef9ee tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:55.733367 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fab94652-643c-405f-b540-2d3723fef9ee tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:55.734019 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fab94652-643c-405f-b540-2d3723fef9ee tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:55.734773 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fab94652-643c-405f-b540-2d3723fef9ee tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:55.871459 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-fab94652-643c-405f-b540-2d3723fef9ee tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:55.880000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-fab94652-643c-405f-b540-2d3723fef9ee tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:55.881470 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-fab94652-643c-405f-b540-2d3723fef9ee tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:55.882732 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-fab94652-643c-405f-b540-2d3723fef9ee tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1725 microversion: 2.20 time: 0.167068 Sep 15 13:06:55.883562 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 358/705] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:06:55 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:06:56.153356 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c3117365-416d-4e5b-8237-cdbd0f3c84b8 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:56.161747 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c3117365-416d-4e5b-8237-cdbd0f3c84b8 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1366 microversion: 2.1 time: 0.602641 Sep 15 13:06:56.162787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 348/706] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:55 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1366 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:06:56.642960 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-f065bd85-aa22-4bd4-ad1d-d3abdb8f484b req-0cb7571f-99eb-4c63-8654-9f0897eba7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcaa24ea-1063-4b3c-b8d8-21d146c1ee89", "tag": "6575d720-dfc5-42ca-a7be-43151adbebde"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:06:56.657962 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-f065bd85-aa22-4bd4-ad1d-d3abdb8f484b req-0cb7571f-99eb-4c63-8654-9f0897eba7c6 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:56.658438 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-f065bd85-aa22-4bd4-ad1d-d3abdb8f484b req-0cb7571f-99eb-4c63-8654-9f0897eba7c6 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:56.658838 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-f065bd85-aa22-4bd4-ad1d-d3abdb8f484b req-0cb7571f-99eb-4c63-8654-9f0897eba7c6 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:56.672467 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-f065bd85-aa22-4bd4-ad1d-d3abdb8f484b req-0cb7571f-99eb-4c63-8654-9f0897eba7c6 service nova] Creating event network-changed:6575d720-dfc5-42ca-a7be-43151adbebde for instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 on hv-cinder-83608 Sep 15 13:06:56.678080 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-f065bd85-aa22-4bd4-ad1d-d3abdb8f484b req-0cb7571f-99eb-4c63-8654-9f0897eba7c6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046124 Sep 15 13:06:56.678717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 359/707] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:06:56.909377 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-32da237b-82bc-4ae7-b719-5a009c32e5f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:56.909984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-32da237b-82bc-4ae7-b719-5a009c32e5f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:56.916708 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-32da237b-82bc-4ae7-b719-5a009c32e5f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:56.917197 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-32da237b-82bc-4ae7-b719-5a009c32e5f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:56.917633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-32da237b-82bc-4ae7-b719-5a009c32e5f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:56.918325 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-32da237b-82bc-4ae7-b719-5a009c32e5f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:56.918777 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-32da237b-82bc-4ae7-b719-5a009c32e5f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:56.919233 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-32da237b-82bc-4ae7-b719-5a009c32e5f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:57.161395 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-32da237b-82bc-4ae7-b719-5a009c32e5f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:57.180254 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-32da237b-82bc-4ae7-b719-5a009c32e5f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:57.182756 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-32da237b-82bc-4ae7-b719-5a009c32e5f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:57.184397 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-32da237b-82bc-4ae7-b719-5a009c32e5f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1725 microversion: 2.20 time: 0.278985 Sep 15 13:06:57.187324 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0a9c2a5c-b17e-4dc0-9661-b8fc60c54ff3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:57.188052 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0a9c2a5c-b17e-4dc0-9661-b8fc60c54ff3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:57.196055 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 349/708] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:06:56 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1725 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:06:57.200724 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0a9c2a5c-b17e-4dc0-9661-b8fc60c54ff3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:57.201498 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0a9c2a5c-b17e-4dc0-9661-b8fc60c54ff3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:57.202089 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0a9c2a5c-b17e-4dc0-9661-b8fc60c54ff3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:57.203063 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0a9c2a5c-b17e-4dc0-9661-b8fc60c54ff3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:57.203846 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0a9c2a5c-b17e-4dc0-9661-b8fc60c54ff3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:57.204600 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0a9c2a5c-b17e-4dc0-9661-b8fc60c54ff3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:57.346712 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0a9c2a5c-b17e-4dc0-9661-b8fc60c54ff3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:57.354578 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0a9c2a5c-b17e-4dc0-9661-b8fc60c54ff3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1366 microversion: 2.1 time: 0.171561 Sep 15 13:06:57.355147 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 360/709] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:57 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:06:58.211732 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-aa150de0-4f4a-443d-a4da-fd0b17f0ee7e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:58.212371 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-aa150de0-4f4a-443d-a4da-fd0b17f0ee7e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:58.219067 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-aa150de0-4f4a-443d-a4da-fd0b17f0ee7e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:58.219553 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-aa150de0-4f4a-443d-a4da-fd0b17f0ee7e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:58.219979 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-aa150de0-4f4a-443d-a4da-fd0b17f0ee7e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:58.220691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-aa150de0-4f4a-443d-a4da-fd0b17f0ee7e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:58.221138 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-aa150de0-4f4a-443d-a4da-fd0b17f0ee7e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:58.221552 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-aa150de0-4f4a-443d-a4da-fd0b17f0ee7e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:58.378215 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d2f4a415-a7b6-4a06-b87b-3abafd5cf084 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:58.379776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d2f4a415-a7b6-4a06-b87b-3abafd5cf084 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:58.390822 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-aa150de0-4f4a-443d-a4da-fd0b17f0ee7e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:58.393230 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2f4a415-a7b6-4a06-b87b-3abafd5cf084 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:58.394852 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2f4a415-a7b6-4a06-b87b-3abafd5cf084 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:58.396666 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2f4a415-a7b6-4a06-b87b-3abafd5cf084 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:58.397694 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2f4a415-a7b6-4a06-b87b-3abafd5cf084 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:58.399644 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2f4a415-a7b6-4a06-b87b-3abafd5cf084 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:58.401484 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-aa150de0-4f4a-443d-a4da-fd0b17f0ee7e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:58.401884 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2f4a415-a7b6-4a06-b87b-3abafd5cf084 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:58.402953 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-aa150de0-4f4a-443d-a4da-fd0b17f0ee7e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:58.404221 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-aa150de0-4f4a-443d-a4da-fd0b17f0ee7e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1725 microversion: 2.20 time: 0.196829 Sep 15 13:06:58.404813 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 350/710] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:06:58 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:06:58.644244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d2f4a415-a7b6-4a06-b87b-3abafd5cf084 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:58.652874 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d2f4a415-a7b6-4a06-b87b-3abafd5cf084 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1366 microversion: 2.1 time: 0.279587 Sep 15 13:06:58.653446 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 361/711] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:58 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:06:59.430279 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-bd4df815-561c-4392-b5f0-c4d70ca9c648 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:59.430882 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-bd4df815-561c-4392-b5f0-c4d70ca9c648 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:59.437080 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bd4df815-561c-4392-b5f0-c4d70ca9c648 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:59.437561 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bd4df815-561c-4392-b5f0-c4d70ca9c648 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:59.437993 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bd4df815-561c-4392-b5f0-c4d70ca9c648 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:59.438713 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bd4df815-561c-4392-b5f0-c4d70ca9c648 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:59.439163 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bd4df815-561c-4392-b5f0-c4d70ca9c648 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:59.439696 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bd4df815-561c-4392-b5f0-c4d70ca9c648 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:59.584165 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-bd4df815-561c-4392-b5f0-c4d70ca9c648 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:59.593572 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-bd4df815-561c-4392-b5f0-c4d70ca9c648 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:59.595008 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-bd4df815-561c-4392-b5f0-c4d70ca9c648 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:59.596164 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-bd4df815-561c-4392-b5f0-c4d70ca9c648 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1725 microversion: 2.20 time: 0.170075 Sep 15 13:06:59.596739 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 351/712] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:06:59 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:06:59.677243 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bf4301c4-2156-48e5-a967-b9f4d37cec94 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:06:59.678139 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-bf4301c4-2156-48e5-a967-b9f4d37cec94 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:06:59.685951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bf4301c4-2156-48e5-a967-b9f4d37cec94 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:59.686512 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bf4301c4-2156-48e5-a967-b9f4d37cec94 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:59.687189 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bf4301c4-2156-48e5-a967-b9f4d37cec94 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:59.688096 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bf4301c4-2156-48e5-a967-b9f4d37cec94 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:06:59.688653 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bf4301c4-2156-48e5-a967-b9f4d37cec94 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:06:59.689148 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bf4301c4-2156-48e5-a967-b9f4d37cec94 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:06:59.861068 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-bf4301c4-2156-48e5-a967-b9f4d37cec94 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:06:59.873006 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-bf4301c4-2156-48e5-a967-b9f4d37cec94 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1366 microversion: 2.1 time: 0.199558 Sep 15 13:06:59.874871 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 362/713] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:06:59 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:07:00.623271 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-dff03b3e-aa2d-47c9-8601-620b353925e7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:00.623800 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-dff03b3e-aa2d-47c9-8601-620b353925e7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:00.629716 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dff03b3e-aa2d-47c9-8601-620b353925e7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:00.630196 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dff03b3e-aa2d-47c9-8601-620b353925e7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:00.630628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dff03b3e-aa2d-47c9-8601-620b353925e7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:00.631315 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dff03b3e-aa2d-47c9-8601-620b353925e7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:00.631762 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dff03b3e-aa2d-47c9-8601-620b353925e7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:00.632210 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dff03b3e-aa2d-47c9-8601-620b353925e7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:00.759993 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-dff03b3e-aa2d-47c9-8601-620b353925e7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:00.767999 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-dff03b3e-aa2d-47c9-8601-620b353925e7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:00.769520 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-dff03b3e-aa2d-47c9-8601-620b353925e7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:00.770946 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-dff03b3e-aa2d-47c9-8601-620b353925e7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1725 microversion: 2.20 time: 0.151670 Sep 15 13:07:00.771505 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 352/714] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:00 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:00.898845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-eeac61a3-718e-4d5b-8c1f-e8d0752527e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:00.899514 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-eeac61a3-718e-4d5b-8c1f-e8d0752527e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:00.905873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eeac61a3-718e-4d5b-8c1f-e8d0752527e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:00.906352 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eeac61a3-718e-4d5b-8c1f-e8d0752527e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:00.906787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eeac61a3-718e-4d5b-8c1f-e8d0752527e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:00.907473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eeac61a3-718e-4d5b-8c1f-e8d0752527e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:00.907924 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eeac61a3-718e-4d5b-8c1f-e8d0752527e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:00.908370 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eeac61a3-718e-4d5b-8c1f-e8d0752527e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:00.912492 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:01.036801 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-eeac61a3-718e-4d5b-8c1f-e8d0752527e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:01.044441 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-eeac61a3-718e-4d5b-8c1f-e8d0752527e4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1366 microversion: 2.1 time: 0.150308 Sep 15 13:07:01.045013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 363/715] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:07:00 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:07:01.797047 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1f8dd77b-c7cd-453b-87df-bfff6a9062b7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:01.797795 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1f8dd77b-c7cd-453b-87df-bfff6a9062b7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:01.803967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1f8dd77b-c7cd-453b-87df-bfff6a9062b7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:01.809359 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1f8dd77b-c7cd-453b-87df-bfff6a9062b7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:01.809923 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1f8dd77b-c7cd-453b-87df-bfff6a9062b7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:01.811049 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1f8dd77b-c7cd-453b-87df-bfff6a9062b7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:01.811580 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1f8dd77b-c7cd-453b-87df-bfff6a9062b7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:01.812356 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1f8dd77b-c7cd-453b-87df-bfff6a9062b7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:01.942980 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1f8dd77b-c7cd-453b-87df-bfff6a9062b7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:01.951963 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1f8dd77b-c7cd-453b-87df-bfff6a9062b7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:01.953428 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1f8dd77b-c7cd-453b-87df-bfff6a9062b7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:01.954590 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1f8dd77b-c7cd-453b-87df-bfff6a9062b7 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1725 microversion: 2.20 time: 0.161482 Sep 15 13:07:01.955154 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 353/716] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:01 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:02.067010 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3e536538-1543-4499-aff6-8ecf8d1cede1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:02.067533 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3e536538-1543-4499-aff6-8ecf8d1cede1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:02.073909 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3e536538-1543-4499-aff6-8ecf8d1cede1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:02.074383 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3e536538-1543-4499-aff6-8ecf8d1cede1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:02.074808 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3e536538-1543-4499-aff6-8ecf8d1cede1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:02.075488 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3e536538-1543-4499-aff6-8ecf8d1cede1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:02.075932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3e536538-1543-4499-aff6-8ecf8d1cede1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:02.076374 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3e536538-1543-4499-aff6-8ecf8d1cede1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:02.213023 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3e536538-1543-4499-aff6-8ecf8d1cede1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:02.221166 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3e536538-1543-4499-aff6-8ecf8d1cede1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1366 microversion: 2.1 time: 0.158059 Sep 15 13:07:02.221775 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 364/717] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:07:02 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:07:02.982096 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-45748162-f79d-4432-b179-758055eb01ad tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:02.982824 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-45748162-f79d-4432-b179-758055eb01ad tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:02.989222 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-45748162-f79d-4432-b179-758055eb01ad tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:02.989706 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-45748162-f79d-4432-b179-758055eb01ad tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:02.990167 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-45748162-f79d-4432-b179-758055eb01ad tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:02.990856 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-45748162-f79d-4432-b179-758055eb01ad tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:02.991310 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-45748162-f79d-4432-b179-758055eb01ad tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:02.991744 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-45748162-f79d-4432-b179-758055eb01ad tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:03.146502 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-45748162-f79d-4432-b179-758055eb01ad tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:03.155891 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-45748162-f79d-4432-b179-758055eb01ad tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:03.157362 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-45748162-f79d-4432-b179-758055eb01ad tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:03.159381 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-45748162-f79d-4432-b179-758055eb01ad tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1725 microversion: 2.20 time: 0.181944 Sep 15 13:07:03.159929 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 354/718] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:02 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:03.245229 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7f0a4669-e1e7-4a47-97dd-85dd75136956 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:03.245821 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7f0a4669-e1e7-4a47-97dd-85dd75136956 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:03.252252 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7f0a4669-e1e7-4a47-97dd-85dd75136956 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:03.252753 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7f0a4669-e1e7-4a47-97dd-85dd75136956 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:03.253185 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7f0a4669-e1e7-4a47-97dd-85dd75136956 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:03.253866 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7f0a4669-e1e7-4a47-97dd-85dd75136956 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:03.254312 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7f0a4669-e1e7-4a47-97dd-85dd75136956 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:03.254725 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7f0a4669-e1e7-4a47-97dd-85dd75136956 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:03.386243 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7f0a4669-e1e7-4a47-97dd-85dd75136956 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:03.393839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7f0a4669-e1e7-4a47-97dd-85dd75136956 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1366 microversion: 2.1 time: 0.153510 Sep 15 13:07:03.394402 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 365/719] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:07:03 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:07:03.414884 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-7403fca3-2d1e-454a-afa6-3b1fedb80571 req-fb8c4feb-d842-4c38-a130-7a0b4ac004c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcaa24ea-1063-4b3c-b8d8-21d146c1ee89", "name": "network-vif-plugged", "status": "completed", "tag": "6575d720-dfc5-42ca-a7be-43151adbebde"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:07:03.420023 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:03.420705 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=10 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:03.427301 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-7403fca3-2d1e-454a-afa6-3b1fedb80571 req-fb8c4feb-d842-4c38-a130-7a0b4ac004c6 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:03.427791 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-7403fca3-2d1e-454a-afa6-3b1fedb80571 req-fb8c4feb-d842-4c38-a130-7a0b4ac004c6 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:03.428206 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-7403fca3-2d1e-454a-afa6-3b1fedb80571 req-fb8c4feb-d842-4c38-a130-7a0b4ac004c6 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:03.440438 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-7403fca3-2d1e-454a-afa6-3b1fedb80571 req-fb8c4feb-d842-4c38-a130-7a0b4ac004c6 service nova] Creating event network-vif-plugged:6575d720-dfc5-42ca-a7be-43151adbebde for instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 on hv-cinder-83608 Sep 15 13:07:03.445415 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-7403fca3-2d1e-454a-afa6-3b1fedb80571 req-fb8c4feb-d842-4c38-a130-7a0b4ac004c6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035379 Sep 15 13:07:03.446188 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 355/720] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:07:04.186667 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c0ed6690-6825-458f-8cb6-b24fd2b389b4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:04.187359 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c0ed6690-6825-458f-8cb6-b24fd2b389b4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:04.189166 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:04.194462 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c0ed6690-6825-458f-8cb6-b24fd2b389b4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:04.194937 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c0ed6690-6825-458f-8cb6-b24fd2b389b4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:04.195364 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c0ed6690-6825-458f-8cb6-b24fd2b389b4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:04.196245 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c0ed6690-6825-458f-8cb6-b24fd2b389b4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:04.196714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c0ed6690-6825-458f-8cb6-b24fd2b389b4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:04.197124 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c0ed6690-6825-458f-8cb6-b24fd2b389b4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:04.333123 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c0ed6690-6825-458f-8cb6-b24fd2b389b4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:04.341286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c0ed6690-6825-458f-8cb6-b24fd2b389b4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:04.342717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c0ed6690-6825-458f-8cb6-b24fd2b389b4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:04.343857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c0ed6690-6825-458f-8cb6-b24fd2b389b4 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1725 microversion: 2.20 time: 0.160986 Sep 15 13:07:04.344443 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 366/721] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:04 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:04.418110 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8975e1b8-31f8-454b-9f2f-2a31459a9d9a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:04.418823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8975e1b8-31f8-454b-9f2f-2a31459a9d9a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:04.424897 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8975e1b8-31f8-454b-9f2f-2a31459a9d9a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:04.425376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8975e1b8-31f8-454b-9f2f-2a31459a9d9a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:04.425810 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8975e1b8-31f8-454b-9f2f-2a31459a9d9a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:04.426523 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8975e1b8-31f8-454b-9f2f-2a31459a9d9a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:04.426977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8975e1b8-31f8-454b-9f2f-2a31459a9d9a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:04.427400 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8975e1b8-31f8-454b-9f2f-2a31459a9d9a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:04.558923 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-8975e1b8-31f8-454b-9f2f-2a31459a9d9a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:04.562451 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:04.567669 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8975e1b8-31f8-454b-9f2f-2a31459a9d9a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1366 microversion: 2.1 time: 0.154899 Sep 15 13:07:04.568244 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 356/722] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:07:04 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:07:05.369138 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cf351c01-50b7-42c8-8223-cfc605acfa33 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:05.369679 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cf351c01-50b7-42c8-8223-cfc605acfa33 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:05.375959 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf351c01-50b7-42c8-8223-cfc605acfa33 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:05.376473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf351c01-50b7-42c8-8223-cfc605acfa33 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:05.376900 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf351c01-50b7-42c8-8223-cfc605acfa33 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:05.377573 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf351c01-50b7-42c8-8223-cfc605acfa33 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:05.378017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf351c01-50b7-42c8-8223-cfc605acfa33 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:05.378430 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf351c01-50b7-42c8-8223-cfc605acfa33 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:05.509839 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cf351c01-50b7-42c8-8223-cfc605acfa33 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:05.518334 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cf351c01-50b7-42c8-8223-cfc605acfa33 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:05.519770 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cf351c01-50b7-42c8-8223-cfc605acfa33 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:05.521415 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cf351c01-50b7-42c8-8223-cfc605acfa33 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1725 microversion: 2.20 time: 0.156627 Sep 15 13:07:05.521967 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 367/723] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:05 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:07:05.593185 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b593db9b-472b-4ed5-96c5-cfe5260b469b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:05.593920 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b593db9b-472b-4ed5-96c5-cfe5260b469b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:05.596892 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:05.601404 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b593db9b-472b-4ed5-96c5-cfe5260b469b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:05.601923 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b593db9b-472b-4ed5-96c5-cfe5260b469b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:05.602386 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b593db9b-472b-4ed5-96c5-cfe5260b469b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:05.603216 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b593db9b-472b-4ed5-96c5-cfe5260b469b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:05.603665 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b593db9b-472b-4ed5-96c5-cfe5260b469b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:05.604086 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b593db9b-472b-4ed5-96c5-cfe5260b469b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:05.748966 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b593db9b-472b-4ed5-96c5-cfe5260b469b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:05.756839 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b593db9b-472b-4ed5-96c5-cfe5260b469b tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1557 microversion: 2.1 time: 0.168955 Sep 15 13:07:05.757428 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 357/724] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:07:05 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:07:05.780770 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-41ae50d4-8717-4724-bccd-266c5d52692d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:05.781262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-41ae50d4-8717-4724-bccd-266c5d52692d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:05.788067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-41ae50d4-8717-4724-bccd-266c5d52692d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:05.788622 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-41ae50d4-8717-4724-bccd-266c5d52692d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:05.789061 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-41ae50d4-8717-4724-bccd-266c5d52692d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:05.789789 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-41ae50d4-8717-4724-bccd-266c5d52692d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:05.790599 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-41ae50d4-8717-4724-bccd-266c5d52692d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:05.791032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-41ae50d4-8717-4724-bccd-266c5d52692d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:05.868700 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-41ae50d4-8717-4724-bccd-266c5d52692d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092097 Sep 15 13:07:05.869285 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 368/725] 10.222.0.57 () {58 vars in 1275 bytes} [Thu Sep 15 13:07:05 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:07:06.547164 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d6998bc3-e92a-4c33-944f-7d6080c00a50 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:06.547877 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d6998bc3-e92a-4c33-944f-7d6080c00a50 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:06.553992 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6998bc3-e92a-4c33-944f-7d6080c00a50 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:06.554480 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6998bc3-e92a-4c33-944f-7d6080c00a50 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:06.554945 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6998bc3-e92a-4c33-944f-7d6080c00a50 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:06.555645 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6998bc3-e92a-4c33-944f-7d6080c00a50 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:06.556099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6998bc3-e92a-4c33-944f-7d6080c00a50 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:06.556545 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6998bc3-e92a-4c33-944f-7d6080c00a50 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:06.693835 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d6998bc3-e92a-4c33-944f-7d6080c00a50 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:06.702421 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d6998bc3-e92a-4c33-944f-7d6080c00a50 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:06.703875 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d6998bc3-e92a-4c33-944f-7d6080c00a50 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:06.705095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d6998bc3-e92a-4c33-944f-7d6080c00a50 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1725 microversion: 2.20 time: 0.161852 Sep 15 13:07:06.705969 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 358/726] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:06 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:07.028509 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-445028be-e2aa-4083-9b29-2350282580be req-cfb192f8-8b05-46c6-b287-70f56ac4448e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcaa24ea-1063-4b3c-b8d8-21d146c1ee89", "tag": "6575d720-dfc5-42ca-a7be-43151adbebde"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:07:07.035142 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:07.042100 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-445028be-e2aa-4083-9b29-2350282580be req-cfb192f8-8b05-46c6-b287-70f56ac4448e service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:07.042859 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-445028be-e2aa-4083-9b29-2350282580be req-cfb192f8-8b05-46c6-b287-70f56ac4448e service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:07.043287 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-445028be-e2aa-4083-9b29-2350282580be req-cfb192f8-8b05-46c6-b287-70f56ac4448e service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:07.055997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-445028be-e2aa-4083-9b29-2350282580be req-cfb192f8-8b05-46c6-b287-70f56ac4448e service nova] Creating event network-changed:6575d720-dfc5-42ca-a7be-43151adbebde for instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 on hv-cinder-83608 Sep 15 13:07:07.061465 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-445028be-e2aa-4083-9b29-2350282580be req-cfb192f8-8b05-46c6-b287-70f56ac4448e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038772 Sep 15 13:07:07.062063 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 369/727] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:07:07.731618 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4f7d573b-4ac3-4cdc-a6bb-bb3a34490e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:07.732326 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-4f7d573b-4ac3-4cdc-a6bb-bb3a34490e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:07.738829 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4f7d573b-4ac3-4cdc-a6bb-bb3a34490e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:07.739579 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4f7d573b-4ac3-4cdc-a6bb-bb3a34490e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:07.740095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4f7d573b-4ac3-4cdc-a6bb-bb3a34490e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:07.741003 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4f7d573b-4ac3-4cdc-a6bb-bb3a34490e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:07.741588 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4f7d573b-4ac3-4cdc-a6bb-bb3a34490e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:07.742033 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4f7d573b-4ac3-4cdc-a6bb-bb3a34490e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:07.877423 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-4f7d573b-4ac3-4cdc-a6bb-bb3a34490e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:07.886988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-4f7d573b-4ac3-4cdc-a6bb-bb3a34490e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:07.888484 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-4f7d573b-4ac3-4cdc-a6bb-bb3a34490e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:07.889646 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-4f7d573b-4ac3-4cdc-a6bb-bb3a34490e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1746 microversion: 2.20 time: 0.162742 Sep 15 13:07:07.890236 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 359/728] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:07 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:08.917582 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4db3d590-5866-4a47-975a-20188a6f82aa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:08.918275 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-4db3d590-5866-4a47-975a-20188a6f82aa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:08.925074 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4db3d590-5866-4a47-975a-20188a6f82aa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:08.925552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4db3d590-5866-4a47-975a-20188a6f82aa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:08.925982 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4db3d590-5866-4a47-975a-20188a6f82aa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:08.926663 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4db3d590-5866-4a47-975a-20188a6f82aa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:08.927131 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4db3d590-5866-4a47-975a-20188a6f82aa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:08.927545 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4db3d590-5866-4a47-975a-20188a6f82aa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:09.053750 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4db3d590-5866-4a47-975a-20188a6f82aa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:09.061711 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4db3d590-5866-4a47-975a-20188a6f82aa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:09.063150 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4db3d590-5866-4a47-975a-20188a6f82aa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:09.064319 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-4db3d590-5866-4a47-975a-20188a6f82aa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1746 microversion: 2.20 time: 0.151848 Sep 15 13:07:09.064876 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 370/729] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:08 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:10.090005 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a19441ff-5a15-47b3-a66e-7d4e04b27c34 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:10.090613 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a19441ff-5a15-47b3-a66e-7d4e04b27c34 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:10.096774 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a19441ff-5a15-47b3-a66e-7d4e04b27c34 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:10.097259 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a19441ff-5a15-47b3-a66e-7d4e04b27c34 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:10.097695 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a19441ff-5a15-47b3-a66e-7d4e04b27c34 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:10.098861 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a19441ff-5a15-47b3-a66e-7d4e04b27c34 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:10.098861 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a19441ff-5a15-47b3-a66e-7d4e04b27c34 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:10.099227 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a19441ff-5a15-47b3-a66e-7d4e04b27c34 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:10.227635 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a19441ff-5a15-47b3-a66e-7d4e04b27c34 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:10.235550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a19441ff-5a15-47b3-a66e-7d4e04b27c34 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:10.237013 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a19441ff-5a15-47b3-a66e-7d4e04b27c34 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:10.238152 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a19441ff-5a15-47b3-a66e-7d4e04b27c34 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1746 microversion: 2.20 time: 0.152782 Sep 15 13:07:10.238708 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 360/730] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:10 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:11.263216 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-93c72c5b-e005-412b-94bf-b9413f7a75f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:11.263831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-93c72c5b-e005-412b-94bf-b9413f7a75f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:11.270296 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-93c72c5b-e005-412b-94bf-b9413f7a75f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:11.271046 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-93c72c5b-e005-412b-94bf-b9413f7a75f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:11.271485 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-93c72c5b-e005-412b-94bf-b9413f7a75f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:11.272205 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-93c72c5b-e005-412b-94bf-b9413f7a75f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:11.272689 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-93c72c5b-e005-412b-94bf-b9413f7a75f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:11.273118 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-93c72c5b-e005-412b-94bf-b9413f7a75f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:11.408381 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-93c72c5b-e005-412b-94bf-b9413f7a75f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:11.418361 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-93c72c5b-e005-412b-94bf-b9413f7a75f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:11.419880 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-93c72c5b-e005-412b-94bf-b9413f7a75f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:11.421086 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-93c72c5b-e005-412b-94bf-b9413f7a75f6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1746 microversion: 2.20 time: 0.161794 Sep 15 13:07:11.421655 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 371/731] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:11 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:07:11.454569 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-4286eb09-2354-44a0-81b5-04b9f3b0927e req-16e27360-853f-46ca-a91a-04c824931902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f141686-0b27-4fd1-9e23-6634ade717ae", "name": "network-vif-plugged", "status": "completed", "tag": "2e211122-d0c5-4c5f-9b31-8e606a42abd5"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:07:11.464777 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-4286eb09-2354-44a0-81b5-04b9f3b0927e req-16e27360-853f-46ca-a91a-04c824931902 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:11.465263 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-4286eb09-2354-44a0-81b5-04b9f3b0927e req-16e27360-853f-46ca-a91a-04c824931902 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:11.465681 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-4286eb09-2354-44a0-81b5-04b9f3b0927e req-16e27360-853f-46ca-a91a-04c824931902 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:11.477426 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-4286eb09-2354-44a0-81b5-04b9f3b0927e req-16e27360-853f-46ca-a91a-04c824931902 service nova] Creating event network-vif-plugged:2e211122-d0c5-4c5f-9b31-8e606a42abd5 for instance 8f141686-0b27-4fd1-9e23-6634ade717ae on hv-cinder-83608 Sep 15 13:07:11.482721 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-4286eb09-2354-44a0-81b5-04b9f3b0927e req-16e27360-853f-46ca-a91a-04c824931902 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031829 Sep 15 13:07:11.483369 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 361/732] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:07:12.447462 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-47663159-00d8-421d-8b01-7714b06e2dea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:12.448069 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-47663159-00d8-421d-8b01-7714b06e2dea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:12.454478 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-47663159-00d8-421d-8b01-7714b06e2dea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:12.454955 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-47663159-00d8-421d-8b01-7714b06e2dea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:12.455390 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-47663159-00d8-421d-8b01-7714b06e2dea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:12.456078 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-47663159-00d8-421d-8b01-7714b06e2dea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:12.456552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-47663159-00d8-421d-8b01-7714b06e2dea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:12.456979 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-47663159-00d8-421d-8b01-7714b06e2dea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:12.582802 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-47663159-00d8-421d-8b01-7714b06e2dea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:12.591536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-47663159-00d8-421d-8b01-7714b06e2dea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:12.593022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-47663159-00d8-421d-8b01-7714b06e2dea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:12.594175 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-47663159-00d8-421d-8b01-7714b06e2dea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1746 microversion: 2.20 time: 0.150714 Sep 15 13:07:12.594740 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 372/733] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:12 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:13.620898 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-062df627-a018-4198-a030-f7045eaba97b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:13.621597 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-062df627-a018-4198-a030-f7045eaba97b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:13.627719 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-062df627-a018-4198-a030-f7045eaba97b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:13.628197 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-062df627-a018-4198-a030-f7045eaba97b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:13.628662 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-062df627-a018-4198-a030-f7045eaba97b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:13.629348 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-062df627-a018-4198-a030-f7045eaba97b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:13.629797 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-062df627-a018-4198-a030-f7045eaba97b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:13.630217 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-062df627-a018-4198-a030-f7045eaba97b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:13.763372 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-062df627-a018-4198-a030-f7045eaba97b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:13.771821 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-062df627-a018-4198-a030-f7045eaba97b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:13.773413 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-062df627-a018-4198-a030-f7045eaba97b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:13.775134 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-062df627-a018-4198-a030-f7045eaba97b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1746 microversion: 2.20 time: 0.158752 Sep 15 13:07:13.775759 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 362/734] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:13 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:14.801428 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-76a16b7d-1746-43a7-a613-c6198cd8915b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:14.802738 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-76a16b7d-1746-43a7-a613-c6198cd8915b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:14.810775 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-76a16b7d-1746-43a7-a613-c6198cd8915b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:14.811540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-76a16b7d-1746-43a7-a613-c6198cd8915b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:14.811978 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-76a16b7d-1746-43a7-a613-c6198cd8915b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:14.813365 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-76a16b7d-1746-43a7-a613-c6198cd8915b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:14.814028 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-76a16b7d-1746-43a7-a613-c6198cd8915b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:14.814648 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-76a16b7d-1746-43a7-a613-c6198cd8915b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:14.973373 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-76a16b7d-1746-43a7-a613-c6198cd8915b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:14.983889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-76a16b7d-1746-43a7-a613-c6198cd8915b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:14.985800 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-76a16b7d-1746-43a7-a613-c6198cd8915b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:14.987098 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-76a16b7d-1746-43a7-a613-c6198cd8915b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1741 microversion: 2.20 time: 0.189970 Sep 15 13:07:14.987888 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 373/735] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:14 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:16.019107 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-047ad042-1425-441c-88ef-c183e3645312 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:16.019783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-047ad042-1425-441c-88ef-c183e3645312 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:16.036826 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-047ad042-1425-441c-88ef-c183e3645312 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:16.037379 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-047ad042-1425-441c-88ef-c183e3645312 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:16.037884 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-047ad042-1425-441c-88ef-c183e3645312 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:16.038619 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-047ad042-1425-441c-88ef-c183e3645312 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:16.040076 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-047ad042-1425-441c-88ef-c183e3645312 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:16.040531 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-047ad042-1425-441c-88ef-c183e3645312 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:16.222525 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-047ad042-1425-441c-88ef-c183e3645312 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:16.232510 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-047ad042-1425-441c-88ef-c183e3645312 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:16.234670 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-047ad042-1425-441c-88ef-c183e3645312 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:16.236028 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-047ad042-1425-441c-88ef-c183e3645312 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1741 microversion: 2.20 time: 0.222117 Sep 15 13:07:16.252314 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 363/736] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:16 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:17.263946 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bbc9017a-8b26-4fe0-8792-53ebaa334e77 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:17.264705 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-bbc9017a-8b26-4fe0-8792-53ebaa334e77 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:17.268548 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 13:07:17.268948 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Thu Sep 15 13:07:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae (ip 10.222.0.57) !!! Sep 15 13:07:17.281435 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bbc9017a-8b26-4fe0-8792-53ebaa334e77 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:17.282245 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bbc9017a-8b26-4fe0-8792-53ebaa334e77 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:17.283094 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bbc9017a-8b26-4fe0-8792-53ebaa334e77 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:17.284027 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bbc9017a-8b26-4fe0-8792-53ebaa334e77 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:17.285085 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bbc9017a-8b26-4fe0-8792-53ebaa334e77 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:17.285730 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bbc9017a-8b26-4fe0-8792-53ebaa334e77 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:17.541767 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-bbc9017a-8b26-4fe0-8792-53ebaa334e77 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:17.551462 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-bbc9017a-8b26-4fe0-8792-53ebaa334e77 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:17.553589 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-bbc9017a-8b26-4fe0-8792-53ebaa334e77 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:17.556225 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-bbc9017a-8b26-4fe0-8792-53ebaa334e77 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1741 microversion: 2.20 time: 0.297076 Sep 15 13:07:17.557085 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 374/737] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:17 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1741 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:18.599169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3398582c-46fb-449b-8896-0c8afa0d920c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:18.599790 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3398582c-46fb-449b-8896-0c8afa0d920c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:18.611076 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3398582c-46fb-449b-8896-0c8afa0d920c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:18.611829 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3398582c-46fb-449b-8896-0c8afa0d920c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:18.612266 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3398582c-46fb-449b-8896-0c8afa0d920c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:18.612997 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3398582c-46fb-449b-8896-0c8afa0d920c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:18.613449 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3398582c-46fb-449b-8896-0c8afa0d920c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:18.613868 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3398582c-46fb-449b-8896-0c8afa0d920c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:18.805716 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3398582c-46fb-449b-8896-0c8afa0d920c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:18.814275 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3398582c-46fb-449b-8896-0c8afa0d920c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:18.816203 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3398582c-46fb-449b-8896-0c8afa0d920c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:18.818063 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3398582c-46fb-449b-8896-0c8afa0d920c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1741 microversion: 2.20 time: 0.223846 Sep 15 13:07:18.818749 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 364/738] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:18 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:19.857826 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-636ced95-38a0-4ef4-8704-4b261fd05e60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:19.858547 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-636ced95-38a0-4ef4-8704-4b261fd05e60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:19.866435 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-636ced95-38a0-4ef4-8704-4b261fd05e60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:19.867715 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-636ced95-38a0-4ef4-8704-4b261fd05e60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:19.868138 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-636ced95-38a0-4ef4-8704-4b261fd05e60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:19.871801 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-636ced95-38a0-4ef4-8704-4b261fd05e60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:19.872375 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-636ced95-38a0-4ef4-8704-4b261fd05e60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:19.872816 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-636ced95-38a0-4ef4-8704-4b261fd05e60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:20.024626 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-636ced95-38a0-4ef4-8704-4b261fd05e60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:20.035553 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-636ced95-38a0-4ef4-8704-4b261fd05e60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:20.037452 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-636ced95-38a0-4ef4-8704-4b261fd05e60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:20.038717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-636ced95-38a0-4ef4-8704-4b261fd05e60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1741 microversion: 2.20 time: 0.184754 Sep 15 13:07:20.039402 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 375/739] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:19 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:21.066908 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-29949706-923f-4bba-8d3c-da36333d4a60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:21.067678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-29949706-923f-4bba-8d3c-da36333d4a60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:21.075211 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-29949706-923f-4bba-8d3c-da36333d4a60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:21.075706 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-29949706-923f-4bba-8d3c-da36333d4a60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:21.076147 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-29949706-923f-4bba-8d3c-da36333d4a60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:21.076880 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-29949706-923f-4bba-8d3c-da36333d4a60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:21.077827 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-29949706-923f-4bba-8d3c-da36333d4a60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:21.078625 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-29949706-923f-4bba-8d3c-da36333d4a60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:21.249695 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-29949706-923f-4bba-8d3c-da36333d4a60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:21.258997 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-29949706-923f-4bba-8d3c-da36333d4a60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:21.260608 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-29949706-923f-4bba-8d3c-da36333d4a60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:21.262102 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-29949706-923f-4bba-8d3c-da36333d4a60 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1741 microversion: 2.20 time: 0.199891 Sep 15 13:07:21.265993 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 365/740] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:21 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:22.299804 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-549e9220-dbf0-48b3-b516-459eadf6c140 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:22.300628 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-549e9220-dbf0-48b3-b516-459eadf6c140 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:22.307606 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-549e9220-dbf0-48b3-b516-459eadf6c140 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:22.308348 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-549e9220-dbf0-48b3-b516-459eadf6c140 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:22.309009 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-549e9220-dbf0-48b3-b516-459eadf6c140 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:22.309932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-549e9220-dbf0-48b3-b516-459eadf6c140 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:22.310619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-549e9220-dbf0-48b3-b516-459eadf6c140 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:22.311290 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-549e9220-dbf0-48b3-b516-459eadf6c140 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:22.473484 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-549e9220-dbf0-48b3-b516-459eadf6c140 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:22.483821 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-549e9220-dbf0-48b3-b516-459eadf6c140 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:22.485562 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-549e9220-dbf0-48b3-b516-459eadf6c140 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:22.487692 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-549e9220-dbf0-48b3-b516-459eadf6c140 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1741 microversion: 2.20 time: 0.196074 Sep 15 13:07:22.490762 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 376/741] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:22 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:23.524448 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-74ef229d-f1c8-48d4-b307-aa0a8c5a31c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:23.525059 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-74ef229d-f1c8-48d4-b307-aa0a8c5a31c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:23.531594 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-74ef229d-f1c8-48d4-b307-aa0a8c5a31c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:23.532097 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-74ef229d-f1c8-48d4-b307-aa0a8c5a31c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:23.532582 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-74ef229d-f1c8-48d4-b307-aa0a8c5a31c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:23.533532 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-74ef229d-f1c8-48d4-b307-aa0a8c5a31c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:23.534157 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-74ef229d-f1c8-48d4-b307-aa0a8c5a31c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:23.534771 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-74ef229d-f1c8-48d4-b307-aa0a8c5a31c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:23.690937 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-74ef229d-f1c8-48d4-b307-aa0a8c5a31c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:23.701033 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-74ef229d-f1c8-48d4-b307-aa0a8c5a31c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:23.702677 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-74ef229d-f1c8-48d4-b307-aa0a8c5a31c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:23.704073 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-74ef229d-f1c8-48d4-b307-aa0a8c5a31c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1741 microversion: 2.20 time: 0.184469 Sep 15 13:07:23.713131 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 366/742] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:23 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:24.731482 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0ee1c114-d606-4c11-9198-576e0c5db960 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:24.732123 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0ee1c114-d606-4c11-9198-576e0c5db960 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:24.741306 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ee1c114-d606-4c11-9198-576e0c5db960 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:24.741788 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ee1c114-d606-4c11-9198-576e0c5db960 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:24.743140 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ee1c114-d606-4c11-9198-576e0c5db960 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:24.744260 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ee1c114-d606-4c11-9198-576e0c5db960 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:24.744825 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ee1c114-d606-4c11-9198-576e0c5db960 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:24.745423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ee1c114-d606-4c11-9198-576e0c5db960 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:24.892171 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0ee1c114-d606-4c11-9198-576e0c5db960 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:24.900702 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0ee1c114-d606-4c11-9198-576e0c5db960 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:24.902153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0ee1c114-d606-4c11-9198-576e0c5db960 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:24.903313 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0ee1c114-d606-4c11-9198-576e0c5db960 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1741 microversion: 2.20 time: 0.175707 Sep 15 13:07:24.903868 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 377/743] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:24 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:25.929677 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c939e1cf-d923-40ae-8c30-35b7da44d032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:25.930353 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c939e1cf-d923-40ae-8c30-35b7da44d032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:25.936445 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c939e1cf-d923-40ae-8c30-35b7da44d032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:25.937089 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c939e1cf-d923-40ae-8c30-35b7da44d032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:25.937648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c939e1cf-d923-40ae-8c30-35b7da44d032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:25.938345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c939e1cf-d923-40ae-8c30-35b7da44d032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:25.939103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c939e1cf-d923-40ae-8c30-35b7da44d032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:25.939535 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c939e1cf-d923-40ae-8c30-35b7da44d032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:26.149604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c939e1cf-d923-40ae-8c30-35b7da44d032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:26.158630 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c939e1cf-d923-40ae-8c30-35b7da44d032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:26.160374 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c939e1cf-d923-40ae-8c30-35b7da44d032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:26.161811 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c939e1cf-d923-40ae-8c30-35b7da44d032 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1723 microversion: 2.20 time: 0.236267 Sep 15 13:07:26.175214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 367/744] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:25 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:27.188931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3fd94872-bf2c-4e39-93d4-bdc0782dc540 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:27.189603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3fd94872-bf2c-4e39-93d4-bdc0782dc540 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:27.195995 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3fd94872-bf2c-4e39-93d4-bdc0782dc540 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:27.197108 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3fd94872-bf2c-4e39-93d4-bdc0782dc540 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:27.197564 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3fd94872-bf2c-4e39-93d4-bdc0782dc540 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:27.198276 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3fd94872-bf2c-4e39-93d4-bdc0782dc540 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:27.198729 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3fd94872-bf2c-4e39-93d4-bdc0782dc540 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:27.199153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3fd94872-bf2c-4e39-93d4-bdc0782dc540 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:27.337885 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3fd94872-bf2c-4e39-93d4-bdc0782dc540 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:27.345874 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3fd94872-bf2c-4e39-93d4-bdc0782dc540 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:27.347304 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3fd94872-bf2c-4e39-93d4-bdc0782dc540 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:27.348525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3fd94872-bf2c-4e39-93d4-bdc0782dc540 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1723 microversion: 2.20 time: 0.163713 Sep 15 13:07:27.349491 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 378/745] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:27 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:28.376699 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5a5391e1-3b54-46d6-93a3-e22ca53ee1f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:28.377231 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5a5391e1-3b54-46d6-93a3-e22ca53ee1f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:28.383410 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5a5391e1-3b54-46d6-93a3-e22ca53ee1f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:28.383910 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5a5391e1-3b54-46d6-93a3-e22ca53ee1f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:28.384361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5a5391e1-3b54-46d6-93a3-e22ca53ee1f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:28.385194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5a5391e1-3b54-46d6-93a3-e22ca53ee1f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:28.385658 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5a5391e1-3b54-46d6-93a3-e22ca53ee1f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:28.386084 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5a5391e1-3b54-46d6-93a3-e22ca53ee1f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:28.522135 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5a5391e1-3b54-46d6-93a3-e22ca53ee1f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:28.530791 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5a5391e1-3b54-46d6-93a3-e22ca53ee1f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:28.532243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5a5391e1-3b54-46d6-93a3-e22ca53ee1f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:28.533417 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5a5391e1-3b54-46d6-93a3-e22ca53ee1f0 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1726 microversion: 2.20 time: 0.161362 Sep 15 13:07:28.533973 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 368/746] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:28 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:28.560408 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-6461a3a2-7167-4e8b-8165-fbe224b36727 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b81888a-87b9-4e96-be5b-e70a0be69951"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:07:28.562794 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-6461a3a2-7167-4e8b-8165-fbe224b36727 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:28.569328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6461a3a2-7167-4e8b-8165-fbe224b36727 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:28.569814 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6461a3a2-7167-4e8b-8165-fbe224b36727 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:28.570244 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6461a3a2-7167-4e8b-8165-fbe224b36727 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:28.570966 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6461a3a2-7167-4e8b-8165-fbe224b36727 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:28.571419 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6461a3a2-7167-4e8b-8165-fbe224b36727 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:28.571840 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6461a3a2-7167-4e8b-8165-fbe224b36727 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:28.755901 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:28.874653 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-6461a3a2-7167-4e8b-8165-fbe224b36727 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "POST /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.318397 Sep 15 13:07:28.875251 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 379/747] 10.222.0.57 () {62 vars in 1364 bytes} [Thu Sep 15 13:07:28 2022] POST /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 13:07:29.006553 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-541017ea-2012-4ce1-9270-58af9ccf1ab6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:29.007050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-541017ea-2012-4ce1-9270-58af9ccf1ab6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:29.014480 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-541017ea-2012-4ce1-9270-58af9ccf1ab6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:29.014972 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-541017ea-2012-4ce1-9270-58af9ccf1ab6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:29.015413 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-541017ea-2012-4ce1-9270-58af9ccf1ab6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:29.016110 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-541017ea-2012-4ce1-9270-58af9ccf1ab6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:29.016597 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-541017ea-2012-4ce1-9270-58af9ccf1ab6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:29.017020 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-541017ea-2012-4ce1-9270-58af9ccf1ab6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:29.257924 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-541017ea-2012-4ce1-9270-58af9ccf1ab6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae/os-volume_attachments/4b81888a-87b9-4e96-be5b-e70a0be69951" status: 202 len: 0 microversion: 2.20 time: 0.255240 Sep 15 13:07:29.258514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 369/748] 10.222.0.57 () {60 vars in 1457 bytes} [Thu Sep 15 13:07:29 2022] DELETE /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae/os-volume_attachments/4b81888a-87b9-4e96-be5b-e70a0be69951 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:07:29.319834 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e236b48a-628c-4a7b-9328-2810d3576708 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:07:29.320484 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e236b48a-628c-4a7b-9328-2810d3576708 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:29.327356 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e236b48a-628c-4a7b-9328-2810d3576708 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:29.327835 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e236b48a-628c-4a7b-9328-2810d3576708 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:29.328295 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e236b48a-628c-4a7b-9328-2810d3576708 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:29.328979 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e236b48a-628c-4a7b-9328-2810d3576708 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:29.329429 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e236b48a-628c-4a7b-9328-2810d3576708 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:29.329845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e236b48a-628c-4a7b-9328-2810d3576708 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:29.359063 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e236b48a-628c-4a7b-9328-2810d3576708 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120633) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 13:07:29.426321 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e236b48a-628c-4a7b-9328-2810d3576708 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "POST /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae/action" status: 202 len: 0 microversion: 2.20 time: 0.110434 Sep 15 13:07:29.426897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 380/749] 10.222.0.57 () {62 vars in 1319 bytes} [Thu Sep 15 13:07:29 2022] POST /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:07:29.436403 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-207ab6a1-612e-478e-bf0b-4e462eeebd52 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:29.436815 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-207ab6a1-612e-478e-bf0b-4e462eeebd52 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:29.442441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-207ab6a1-612e-478e-bf0b-4e462eeebd52 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:29.443166 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-207ab6a1-612e-478e-bf0b-4e462eeebd52 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:29.443601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-207ab6a1-612e-478e-bf0b-4e462eeebd52 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:29.444513 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-207ab6a1-612e-478e-bf0b-4e462eeebd52 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:29.444970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-207ab6a1-612e-478e-bf0b-4e462eeebd52 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:29.445414 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-207ab6a1-612e-478e-bf0b-4e462eeebd52 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:29.552145 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-e9f415bb-408f-4dc4-ad43-e57ee17ce300 req-39aa4227-ad66-47ef-85e6-8130de2b8375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f141686-0b27-4fd1-9e23-6634ade717ae", "name": "network-vif-unplugged", "status": "completed", "tag": "2e211122-d0c5-4c5f-9b31-8e606a42abd5"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:07:29.563131 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e9f415bb-408f-4dc4-ad43-e57ee17ce300 req-39aa4227-ad66-47ef-85e6-8130de2b8375 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:29.563742 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e9f415bb-408f-4dc4-ad43-e57ee17ce300 req-39aa4227-ad66-47ef-85e6-8130de2b8375 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:29.564071 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e9f415bb-408f-4dc4-ad43-e57ee17ce300 req-39aa4227-ad66-47ef-85e6-8130de2b8375 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:29.578064 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.compute.server_external_events [req-e9f415bb-408f-4dc4-ad43-e57ee17ce300 req-39aa4227-ad66-47ef-85e6-8130de2b8375 service nova] Unable to find a host for instance 8f141686-0b27-4fd1-9e23-6634ade717ae. Dropping event network-vif-unplugged {{(pid=120633) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 15 13:07:29.578944 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-e9f415bb-408f-4dc4-ad43-e57ee17ce300 req-39aa4227-ad66-47ef-85e6-8130de2b8375 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031296 Sep 15 13:07:29.579713 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 381/750] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 15 13:07:29.619741 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-207ab6a1-612e-478e-bf0b-4e462eeebd52 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:29.629544 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-207ab6a1-612e-478e-bf0b-4e462eeebd52 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:29.631166 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-207ab6a1-612e-478e-bf0b-4e462eeebd52 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:29.632357 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-207ab6a1-612e-478e-bf0b-4e462eeebd52 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1674 microversion: 2.20 time: 0.201266 Sep 15 13:07:29.632910 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 370/751] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:29 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1674 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:30.658754 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-91e81d3d-e0cc-4907-ab91-f4e87e09beba tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:30.659363 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-91e81d3d-e0cc-4907-ab91-f4e87e09beba tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:30.666457 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-91e81d3d-e0cc-4907-ab91-f4e87e09beba tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:30.667084 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-91e81d3d-e0cc-4907-ab91-f4e87e09beba tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:30.667619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-91e81d3d-e0cc-4907-ab91-f4e87e09beba tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:30.668208 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-91e81d3d-e0cc-4907-ab91-f4e87e09beba tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:30.668687 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-91e81d3d-e0cc-4907-ab91-f4e87e09beba tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:30.669108 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-91e81d3d-e0cc-4907-ab91-f4e87e09beba tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:30.799275 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-91e81d3d-e0cc-4907-ab91-f4e87e09beba tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:30.807459 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-91e81d3d-e0cc-4907-ab91-f4e87e09beba tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:30.808935 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-91e81d3d-e0cc-4907-ab91-f4e87e09beba tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:30.810103 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-91e81d3d-e0cc-4907-ab91-f4e87e09beba tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.155154 Sep 15 13:07:30.810658 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 382/752] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:30 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:07:31.836337 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3a0da231-3ec7-4d65-9d28-dbb3a065e0c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:31.836948 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3a0da231-3ec7-4d65-9d28-dbb3a065e0c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:31.844327 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a0da231-3ec7-4d65-9d28-dbb3a065e0c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:31.844819 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a0da231-3ec7-4d65-9d28-dbb3a065e0c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:31.845253 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a0da231-3ec7-4d65-9d28-dbb3a065e0c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:31.846126 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a0da231-3ec7-4d65-9d28-dbb3a065e0c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:31.846670 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a0da231-3ec7-4d65-9d28-dbb3a065e0c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:31.847098 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3a0da231-3ec7-4d65-9d28-dbb3a065e0c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:31.980434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3a0da231-3ec7-4d65-9d28-dbb3a065e0c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:31.982841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:31.991012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3a0da231-3ec7-4d65-9d28-dbb3a065e0c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:31.992524 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3a0da231-3ec7-4d65-9d28-dbb3a065e0c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:31.995320 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3a0da231-3ec7-4d65-9d28-dbb3a065e0c6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.162429 Sep 15 13:07:31.995926 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 371/753] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:31 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:33.021997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-76ecb869-e315-4353-8f5c-8dd40459572a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:33.022596 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-76ecb869-e315-4353-8f5c-8dd40459572a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:33.029368 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-76ecb869-e315-4353-8f5c-8dd40459572a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:33.030158 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-76ecb869-e315-4353-8f5c-8dd40459572a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:33.030749 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-76ecb869-e315-4353-8f5c-8dd40459572a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:33.031908 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-76ecb869-e315-4353-8f5c-8dd40459572a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:33.032553 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-76ecb869-e315-4353-8f5c-8dd40459572a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:33.033138 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-76ecb869-e315-4353-8f5c-8dd40459572a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:33.174033 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-76ecb869-e315-4353-8f5c-8dd40459572a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:33.182961 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-76ecb869-e315-4353-8f5c-8dd40459572a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:33.184438 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-76ecb869-e315-4353-8f5c-8dd40459572a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:33.185599 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-76ecb869-e315-4353-8f5c-8dd40459572a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.167993 Sep 15 13:07:33.186159 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 383/754] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:33 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:34.212057 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-77aaeab9-fb81-4b31-a017-c429921eae6c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:34.213349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-77aaeab9-fb81-4b31-a017-c429921eae6c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:34.219816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-77aaeab9-fb81-4b31-a017-c429921eae6c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:34.220433 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-77aaeab9-fb81-4b31-a017-c429921eae6c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:34.220926 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-77aaeab9-fb81-4b31-a017-c429921eae6c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:34.221637 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-77aaeab9-fb81-4b31-a017-c429921eae6c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:34.222087 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-77aaeab9-fb81-4b31-a017-c429921eae6c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:34.222505 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-77aaeab9-fb81-4b31-a017-c429921eae6c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:34.354376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-77aaeab9-fb81-4b31-a017-c429921eae6c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:34.362662 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-77aaeab9-fb81-4b31-a017-c429921eae6c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:34.364119 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-77aaeab9-fb81-4b31-a017-c429921eae6c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:34.365327 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-77aaeab9-fb81-4b31-a017-c429921eae6c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.157510 Sep 15 13:07:34.365892 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 372/755] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:34 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:35.392164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d4a1ea38-a9e8-4c91-b8d1-1aae3bdecf69 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:35.392784 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d4a1ea38-a9e8-4c91-b8d1-1aae3bdecf69 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:35.399935 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d4a1ea38-a9e8-4c91-b8d1-1aae3bdecf69 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:35.400887 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d4a1ea38-a9e8-4c91-b8d1-1aae3bdecf69 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:35.401688 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d4a1ea38-a9e8-4c91-b8d1-1aae3bdecf69 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:35.402639 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d4a1ea38-a9e8-4c91-b8d1-1aae3bdecf69 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:35.403312 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d4a1ea38-a9e8-4c91-b8d1-1aae3bdecf69 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:35.403949 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d4a1ea38-a9e8-4c91-b8d1-1aae3bdecf69 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:35.548234 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d4a1ea38-a9e8-4c91-b8d1-1aae3bdecf69 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:35.556831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d4a1ea38-a9e8-4c91-b8d1-1aae3bdecf69 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:35.558893 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d4a1ea38-a9e8-4c91-b8d1-1aae3bdecf69 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:35.560070 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d4a1ea38-a9e8-4c91-b8d1-1aae3bdecf69 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.171796 Sep 15 13:07:35.560835 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 384/756] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:35 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:07:36.586211 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6081586a-0e64-4e4e-a4f2-25c521143b87 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:36.587056 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6081586a-0e64-4e4e-a4f2-25c521143b87 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:36.588843 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=32 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:36.595022 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6081586a-0e64-4e4e-a4f2-25c521143b87 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:36.595614 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6081586a-0e64-4e4e-a4f2-25c521143b87 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:36.596059 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6081586a-0e64-4e4e-a4f2-25c521143b87 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:36.596806 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6081586a-0e64-4e4e-a4f2-25c521143b87 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:36.597263 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6081586a-0e64-4e4e-a4f2-25c521143b87 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:36.597750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6081586a-0e64-4e4e-a4f2-25c521143b87 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:36.742280 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6081586a-0e64-4e4e-a4f2-25c521143b87 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:36.753081 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6081586a-0e64-4e4e-a4f2-25c521143b87 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:36.754793 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6081586a-0e64-4e4e-a4f2-25c521143b87 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:36.756013 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6081586a-0e64-4e4e-a4f2-25c521143b87 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.173705 Sep 15 13:07:36.756869 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 373/757] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:36 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:37.782995 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d0621d66-8a1d-4e02-8b93-0cc7027b6238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:37.783630 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d0621d66-8a1d-4e02-8b93-0cc7027b6238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:37.792785 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d0621d66-8a1d-4e02-8b93-0cc7027b6238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:37.794148 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d0621d66-8a1d-4e02-8b93-0cc7027b6238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:37.795109 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d0621d66-8a1d-4e02-8b93-0cc7027b6238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:37.796551 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d0621d66-8a1d-4e02-8b93-0cc7027b6238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:37.797229 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d0621d66-8a1d-4e02-8b93-0cc7027b6238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:37.797977 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d0621d66-8a1d-4e02-8b93-0cc7027b6238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:37.948227 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d0621d66-8a1d-4e02-8b93-0cc7027b6238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:37.962696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d0621d66-8a1d-4e02-8b93-0cc7027b6238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:37.964807 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d0621d66-8a1d-4e02-8b93-0cc7027b6238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:37.965986 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d0621d66-8a1d-4e02-8b93-0cc7027b6238 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.186861 Sep 15 13:07:37.966748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 385/758] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:37 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:38.992112 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6f3419ee-1aad-4227-a418-2ae97fd10256 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:38.992753 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6f3419ee-1aad-4227-a418-2ae97fd10256 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:39.001584 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6f3419ee-1aad-4227-a418-2ae97fd10256 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:39.002062 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6f3419ee-1aad-4227-a418-2ae97fd10256 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:39.002493 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6f3419ee-1aad-4227-a418-2ae97fd10256 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:39.003174 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6f3419ee-1aad-4227-a418-2ae97fd10256 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:39.003623 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6f3419ee-1aad-4227-a418-2ae97fd10256 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:39.004035 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6f3419ee-1aad-4227-a418-2ae97fd10256 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:39.152462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6f3419ee-1aad-4227-a418-2ae97fd10256 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:39.161012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6f3419ee-1aad-4227-a418-2ae97fd10256 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:39.162468 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6f3419ee-1aad-4227-a418-2ae97fd10256 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:39.163645 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6f3419ee-1aad-4227-a418-2ae97fd10256 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.175412 Sep 15 13:07:39.180367 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 374/759] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:38 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:40.191857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cdbe0676-f9f3-4734-ab75-20c5aa23c22b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:40.192769 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cdbe0676-f9f3-4734-ab75-20c5aa23c22b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:40.195357 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:40.201431 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cdbe0676-f9f3-4734-ab75-20c5aa23c22b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:40.201917 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cdbe0676-f9f3-4734-ab75-20c5aa23c22b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:40.202398 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cdbe0676-f9f3-4734-ab75-20c5aa23c22b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:40.203098 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cdbe0676-f9f3-4734-ab75-20c5aa23c22b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:40.203549 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cdbe0676-f9f3-4734-ab75-20c5aa23c22b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:40.203978 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cdbe0676-f9f3-4734-ab75-20c5aa23c22b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:40.349057 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cdbe0676-f9f3-4734-ab75-20c5aa23c22b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:40.349316 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cdbe0676-f9f3-4734-ab75-20c5aa23c22b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:40.350634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cdbe0676-f9f3-4734-ab75-20c5aa23c22b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:40.351946 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cdbe0676-f9f3-4734-ab75-20c5aa23c22b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.164886 Sep 15 13:07:40.352545 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 386/760] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:40 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:41.378823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-abcab149-eeb3-486f-9de8-8108d979ccc8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:41.379436 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-abcab149-eeb3-486f-9de8-8108d979ccc8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:41.385370 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abcab149-eeb3-486f-9de8-8108d979ccc8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:41.385852 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abcab149-eeb3-486f-9de8-8108d979ccc8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:41.386286 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abcab149-eeb3-486f-9de8-8108d979ccc8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:41.386980 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abcab149-eeb3-486f-9de8-8108d979ccc8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:41.387431 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abcab149-eeb3-486f-9de8-8108d979ccc8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:41.387854 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-abcab149-eeb3-486f-9de8-8108d979ccc8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:41.531469 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-abcab149-eeb3-486f-9de8-8108d979ccc8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:41.541626 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-abcab149-eeb3-486f-9de8-8108d979ccc8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:41.543398 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-abcab149-eeb3-486f-9de8-8108d979ccc8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:41.544430 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-abcab149-eeb3-486f-9de8-8108d979ccc8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.169455 Sep 15 13:07:41.545871 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 375/761] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:41 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:42.570975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a489ecfa-356b-4f7d-ab25-8c8eeb4bf26a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:42.571576 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a489ecfa-356b-4f7d-ab25-8c8eeb4bf26a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:42.579076 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a489ecfa-356b-4f7d-ab25-8c8eeb4bf26a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:42.579554 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a489ecfa-356b-4f7d-ab25-8c8eeb4bf26a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:42.579986 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a489ecfa-356b-4f7d-ab25-8c8eeb4bf26a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:42.581014 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a489ecfa-356b-4f7d-ab25-8c8eeb4bf26a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:42.581462 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a489ecfa-356b-4f7d-ab25-8c8eeb4bf26a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:42.581878 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a489ecfa-356b-4f7d-ab25-8c8eeb4bf26a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:42.711969 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a489ecfa-356b-4f7d-ab25-8c8eeb4bf26a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:42.720608 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a489ecfa-356b-4f7d-ab25-8c8eeb4bf26a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:42.722093 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a489ecfa-356b-4f7d-ab25-8c8eeb4bf26a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:42.723236 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a489ecfa-356b-4f7d-ab25-8c8eeb4bf26a tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.156298 Sep 15 13:07:42.723918 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 387/762] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:42 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:43.749133 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a7b4765e-bbc8-483b-a8c6-7b16207a84ea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:43.749752 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a7b4765e-bbc8-483b-a8c6-7b16207a84ea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:43.755876 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a7b4765e-bbc8-483b-a8c6-7b16207a84ea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:43.756389 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a7b4765e-bbc8-483b-a8c6-7b16207a84ea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:43.756831 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a7b4765e-bbc8-483b-a8c6-7b16207a84ea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:43.757520 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a7b4765e-bbc8-483b-a8c6-7b16207a84ea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:43.757974 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a7b4765e-bbc8-483b-a8c6-7b16207a84ea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:43.758394 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a7b4765e-bbc8-483b-a8c6-7b16207a84ea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:43.889485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a7b4765e-bbc8-483b-a8c6-7b16207a84ea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:43.897866 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a7b4765e-bbc8-483b-a8c6-7b16207a84ea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:43.899323 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a7b4765e-bbc8-483b-a8c6-7b16207a84ea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:43.900525 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a7b4765e-bbc8-483b-a8c6-7b16207a84ea tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.155503 Sep 15 13:07:43.901095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 376/763] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:43 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:44.722932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-da5d0c51-1b2a-437e-84e0-e82dd500358c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:44.723461 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-da5d0c51-1b2a-437e-84e0-e82dd500358c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:44.729708 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-da5d0c51-1b2a-437e-84e0-e82dd500358c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:44.730187 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-da5d0c51-1b2a-437e-84e0-e82dd500358c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:44.730618 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-da5d0c51-1b2a-437e-84e0-e82dd500358c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:44.731307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-da5d0c51-1b2a-437e-84e0-e82dd500358c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:44.731769 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-da5d0c51-1b2a-437e-84e0-e82dd500358c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:44.732881 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-da5d0c51-1b2a-437e-84e0-e82dd500358c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:44.755858 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-da5d0c51-1b2a-437e-84e0-e82dd500358c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/ips" status: 200 len: 144 microversion: 2.1 time: 0.036922 Sep 15 13:07:44.756437 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 388/764] 10.222.0.57 () {58 vars in 1248 bytes} [Thu Sep 15 13:07:44 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:07:44.926686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-84a7e1cb-da8c-4f9b-b322-22749f5af4fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:44.927306 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-84a7e1cb-da8c-4f9b-b322-22749f5af4fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:44.933750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-84a7e1cb-da8c-4f9b-b322-22749f5af4fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:44.934314 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-84a7e1cb-da8c-4f9b-b322-22749f5af4fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:44.934754 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-84a7e1cb-da8c-4f9b-b322-22749f5af4fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:44.936007 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-84a7e1cb-da8c-4f9b-b322-22749f5af4fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:44.936493 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-84a7e1cb-da8c-4f9b-b322-22749f5af4fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:44.936911 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-84a7e1cb-da8c-4f9b-b322-22749f5af4fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:45.099684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-84a7e1cb-da8c-4f9b-b322-22749f5af4fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:45.107901 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-84a7e1cb-da8c-4f9b-b322-22749f5af4fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:45.109373 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-84a7e1cb-da8c-4f9b-b322-22749f5af4fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:45.110529 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-84a7e1cb-da8c-4f9b-b322-22749f5af4fa tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.187809 Sep 15 13:07:45.111079 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 377/765] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:44 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:46.134912 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-fde3bfe3-a388-4b8f-9561-7c9e4e61f99b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:46.135550 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-fde3bfe3-a388-4b8f-9561-7c9e4e61f99b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:46.142408 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fde3bfe3-a388-4b8f-9561-7c9e4e61f99b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:46.142890 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fde3bfe3-a388-4b8f-9561-7c9e4e61f99b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:46.143327 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fde3bfe3-a388-4b8f-9561-7c9e4e61f99b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:46.144021 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fde3bfe3-a388-4b8f-9561-7c9e4e61f99b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:46.144507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fde3bfe3-a388-4b8f-9561-7c9e4e61f99b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:46.144930 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fde3bfe3-a388-4b8f-9561-7c9e4e61f99b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:46.270501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-fde3bfe3-a388-4b8f-9561-7c9e4e61f99b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:46.279379 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-fde3bfe3-a388-4b8f-9561-7c9e4e61f99b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:46.280984 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-fde3bfe3-a388-4b8f-9561-7c9e4e61f99b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:46.282142 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-fde3bfe3-a388-4b8f-9561-7c9e4e61f99b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.151167 Sep 15 13:07:46.282694 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 389/766] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:46 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:47.307814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-25eb96d5-0e02-4be9-9410-3b8987e690eb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:47.308459 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-25eb96d5-0e02-4be9-9410-3b8987e690eb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:47.314890 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-25eb96d5-0e02-4be9-9410-3b8987e690eb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:47.315378 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-25eb96d5-0e02-4be9-9410-3b8987e690eb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:47.315841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-25eb96d5-0e02-4be9-9410-3b8987e690eb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:47.316565 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-25eb96d5-0e02-4be9-9410-3b8987e690eb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:47.317019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-25eb96d5-0e02-4be9-9410-3b8987e690eb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:47.317466 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-25eb96d5-0e02-4be9-9410-3b8987e690eb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:47.459230 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-25eb96d5-0e02-4be9-9410-3b8987e690eb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:47.467361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-25eb96d5-0e02-4be9-9410-3b8987e690eb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:47.468831 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-25eb96d5-0e02-4be9-9410-3b8987e690eb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:47.469985 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-25eb96d5-0e02-4be9-9410-3b8987e690eb tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.166063 Sep 15 13:07:47.470546 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 378/767] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:47 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:48.497797 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-36eba350-1fb3-4589-b1ec-6142097765f2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:48.498491 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-36eba350-1fb3-4589-b1ec-6142097765f2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:48.505038 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-36eba350-1fb3-4589-b1ec-6142097765f2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:48.505527 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-36eba350-1fb3-4589-b1ec-6142097765f2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:48.505965 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-36eba350-1fb3-4589-b1ec-6142097765f2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:48.506659 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-36eba350-1fb3-4589-b1ec-6142097765f2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:48.507115 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-36eba350-1fb3-4589-b1ec-6142097765f2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:48.507541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-36eba350-1fb3-4589-b1ec-6142097765f2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:48.635758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-36eba350-1fb3-4589-b1ec-6142097765f2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:48.644546 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-36eba350-1fb3-4589-b1ec-6142097765f2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:48.646269 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-36eba350-1fb3-4589-b1ec-6142097765f2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:48.647425 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-36eba350-1fb3-4589-b1ec-6142097765f2 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.154086 Sep 15 13:07:48.647987 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 390/768] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:48 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:49.673291 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f8b87fbc-09d8-4a8f-8e37-3bc916d5255e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:49.673923 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f8b87fbc-09d8-4a8f-8e37-3bc916d5255e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:49.679841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f8b87fbc-09d8-4a8f-8e37-3bc916d5255e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:49.680351 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f8b87fbc-09d8-4a8f-8e37-3bc916d5255e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:49.680785 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f8b87fbc-09d8-4a8f-8e37-3bc916d5255e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:49.681462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f8b87fbc-09d8-4a8f-8e37-3bc916d5255e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:49.681905 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f8b87fbc-09d8-4a8f-8e37-3bc916d5255e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:49.682319 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f8b87fbc-09d8-4a8f-8e37-3bc916d5255e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:49.813238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f8b87fbc-09d8-4a8f-8e37-3bc916d5255e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:49.821285 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f8b87fbc-09d8-4a8f-8e37-3bc916d5255e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:49.822705 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f8b87fbc-09d8-4a8f-8e37-3bc916d5255e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:49.823848 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f8b87fbc-09d8-4a8f-8e37-3bc916d5255e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.155020 Sep 15 13:07:49.824420 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 379/769] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:49 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:50.849041 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-db2776c0-4953-4780-9987-a6f46800e120 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:50.849654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-db2776c0-4953-4780-9987-a6f46800e120 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:50.856040 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db2776c0-4953-4780-9987-a6f46800e120 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:50.856592 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db2776c0-4953-4780-9987-a6f46800e120 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:50.857650 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db2776c0-4953-4780-9987-a6f46800e120 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:50.858351 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db2776c0-4953-4780-9987-a6f46800e120 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:50.858825 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db2776c0-4953-4780-9987-a6f46800e120 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:50.859225 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db2776c0-4953-4780-9987-a6f46800e120 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:50.993380 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-db2776c0-4953-4780-9987-a6f46800e120 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:51.002196 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-db2776c0-4953-4780-9987-a6f46800e120 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:51.003649 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-db2776c0-4953-4780-9987-a6f46800e120 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:51.004842 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-db2776c0-4953-4780-9987-a6f46800e120 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.159785 Sep 15 13:07:51.005405 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 391/770] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:50 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:52.030768 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a73128a6-7c7b-4660-b6fb-2141548ada84 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:52.031382 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a73128a6-7c7b-4660-b6fb-2141548ada84 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:52.037337 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a73128a6-7c7b-4660-b6fb-2141548ada84 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:52.037821 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a73128a6-7c7b-4660-b6fb-2141548ada84 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:52.038261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a73128a6-7c7b-4660-b6fb-2141548ada84 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:52.038951 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a73128a6-7c7b-4660-b6fb-2141548ada84 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:52.039408 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a73128a6-7c7b-4660-b6fb-2141548ada84 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:52.039874 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a73128a6-7c7b-4660-b6fb-2141548ada84 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:52.256342 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a73128a6-7c7b-4660-b6fb-2141548ada84 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:52.264996 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a73128a6-7c7b-4660-b6fb-2141548ada84 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:52.266433 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a73128a6-7c7b-4660-b6fb-2141548ada84 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:52.267589 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a73128a6-7c7b-4660-b6fb-2141548ada84 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.241453 Sep 15 13:07:52.268154 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 380/771] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:52 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:53.292899 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-10d11507-6c9c-48d2-a11d-fe8699d62e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:53.293541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-10d11507-6c9c-48d2-a11d-fe8699d62e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:53.301010 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-10d11507-6c9c-48d2-a11d-fe8699d62e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:53.301493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-10d11507-6c9c-48d2-a11d-fe8699d62e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:53.301949 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-10d11507-6c9c-48d2-a11d-fe8699d62e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:53.302643 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-10d11507-6c9c-48d2-a11d-fe8699d62e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:53.303096 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-10d11507-6c9c-48d2-a11d-fe8699d62e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:53.303517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-10d11507-6c9c-48d2-a11d-fe8699d62e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:53.430620 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-10d11507-6c9c-48d2-a11d-fe8699d62e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:53.439442 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-10d11507-6c9c-48d2-a11d-fe8699d62e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:53.440922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-10d11507-6c9c-48d2-a11d-fe8699d62e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:53.442086 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-10d11507-6c9c-48d2-a11d-fe8699d62e68 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.153101 Sep 15 13:07:53.442644 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 392/772] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:53 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:53.488118 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-214c9203-39e6-4aa9-a935-bb253481bde5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61046431-a9a7-4d98-bd8f-deaf0755bb07"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:07:53.490580 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-214c9203-39e6-4aa9-a935-bb253481bde5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:53.496561 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-214c9203-39e6-4aa9-a935-bb253481bde5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:53.497045 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-214c9203-39e6-4aa9-a935-bb253481bde5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:53.498087 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-214c9203-39e6-4aa9-a935-bb253481bde5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:53.498770 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-214c9203-39e6-4aa9-a935-bb253481bde5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:53.499220 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-214c9203-39e6-4aa9-a935-bb253481bde5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:53.499640 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-214c9203-39e6-4aa9-a935-bb253481bde5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:53.828834 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-214c9203-39e6-4aa9-a935-bb253481bde5 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "POST /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344350 Sep 15 13:07:53.829830 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 381/773] 10.222.0.57 () {60 vars in 1323 bytes} [Thu Sep 15 13:07:53 2022] POST /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:07:54.469851 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-988e19a4-2098-45c0-98ce-325f4204f285 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:54.470458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-988e19a4-2098-45c0-98ce-325f4204f285 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:54.476841 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-988e19a4-2098-45c0-98ce-325f4204f285 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:54.477323 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-988e19a4-2098-45c0-98ce-325f4204f285 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:54.477757 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-988e19a4-2098-45c0-98ce-325f4204f285 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:54.478453 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-988e19a4-2098-45c0-98ce-325f4204f285 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:54.478903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-988e19a4-2098-45c0-98ce-325f4204f285 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:54.479357 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-988e19a4-2098-45c0-98ce-325f4204f285 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:54.597626 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-68fabb86-a7ef-4a9d-8e1f-d546ff2faac6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:54.598213 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-68fabb86-a7ef-4a9d-8e1f-d546ff2faac6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:54.605359 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-68fabb86-a7ef-4a9d-8e1f-d546ff2faac6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:54.605851 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-68fabb86-a7ef-4a9d-8e1f-d546ff2faac6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:54.606288 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-68fabb86-a7ef-4a9d-8e1f-d546ff2faac6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:54.607732 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-68fabb86-a7ef-4a9d-8e1f-d546ff2faac6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:54.608301 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-68fabb86-a7ef-4a9d-8e1f-d546ff2faac6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:54.608723 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-68fabb86-a7ef-4a9d-8e1f-d546ff2faac6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:54.624570 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-988e19a4-2098-45c0-98ce-325f4204f285 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:54.634212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-988e19a4-2098-45c0-98ce-325f4204f285 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:54.635790 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-988e19a4-2098-45c0-98ce-325f4204f285 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:54.637280 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-988e19a4-2098-45c0-98ce-325f4204f285 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.173239 Sep 15 13:07:54.656306 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-68fabb86-a7ef-4a9d-8e1f-d546ff2faac6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Going to try to terminate instance {{(pid=120634) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:07:54.656563 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 393/774] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:54 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:54.656563 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-dd8ea7be-412e-4324-a931-7ffb08edbe63 req-2064eadb-a58d-4b22-9a54-8c13a9af32d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2628b91-c3d5-4bc0-88ed-c6786c051876", "tag": "80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:07:54.656563 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-dd8ea7be-412e-4324-a931-7ffb08edbe63 req-2064eadb-a58d-4b22-9a54-8c13a9af32d4 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:54.656563 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-dd8ea7be-412e-4324-a931-7ffb08edbe63 req-2064eadb-a58d-4b22-9a54-8c13a9af32d4 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:54.656894 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-dd8ea7be-412e-4324-a931-7ffb08edbe63 req-2064eadb-a58d-4b22-9a54-8c13a9af32d4 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:54.666357 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-dd8ea7be-412e-4324-a931-7ffb08edbe63 req-2064eadb-a58d-4b22-9a54-8c13a9af32d4 service nova] Creating event network-changed:80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80 for instance e2628b91-c3d5-4bc0-88ed-c6786c051876 on hv-cinder-83608 Sep 15 13:07:54.671900 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-dd8ea7be-412e-4324-a931-7ffb08edbe63 req-2064eadb-a58d-4b22-9a54-8c13a9af32d4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032234 Sep 15 13:07:54.673230 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 394/775] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:07:54.730873 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-68fabb86-a7ef-4a9d-8e1f-d546ff2faac6 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 204 len: 0 microversion: 2.1 time: 0.137069 Sep 15 13:07:54.735440 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 382/776] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:07:54 2022] DELETE /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 13:07:54.745176 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-836981b9-761f-428b-8e57-a0a666cbb02c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:54.746102 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-836981b9-761f-428b-8e57-a0a666cbb02c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:54.755582 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-836981b9-761f-428b-8e57-a0a666cbb02c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:54.756728 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-836981b9-761f-428b-8e57-a0a666cbb02c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:54.757179 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-836981b9-761f-428b-8e57-a0a666cbb02c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:54.757892 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-836981b9-761f-428b-8e57-a0a666cbb02c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:54.758506 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-836981b9-761f-428b-8e57-a0a666cbb02c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:54.758775 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-836981b9-761f-428b-8e57-a0a666cbb02c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:54.780011 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:54.902876 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-836981b9-761f-428b-8e57-a0a666cbb02c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:54.912596 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-836981b9-761f-428b-8e57-a0a666cbb02c tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.175562 Sep 15 13:07:54.913386 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 395/777] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:07:54 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:07:55.666556 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0f6213cc-4686-4171-8c44-71f2df1b7711 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:55.667360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0f6213cc-4686-4171-8c44-71f2df1b7711 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:55.675103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f6213cc-4686-4171-8c44-71f2df1b7711 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:55.675893 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f6213cc-4686-4171-8c44-71f2df1b7711 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:55.676395 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f6213cc-4686-4171-8c44-71f2df1b7711 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:55.677105 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f6213cc-4686-4171-8c44-71f2df1b7711 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:55.677557 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f6213cc-4686-4171-8c44-71f2df1b7711 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:55.678176 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0f6213cc-4686-4171-8c44-71f2df1b7711 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:55.757497 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-790ac5a6-c5be-4970-868c-44e5603621a1 req-4535e69f-57e3-4e4f-9a42-5fdb0aad1daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f141686-0b27-4fd1-9e23-6634ade717ae", "name": "network-vif-plugged", "status": "completed", "tag": "2e211122-d0c5-4c5f-9b31-8e606a42abd5"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:07:55.770110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-790ac5a6-c5be-4970-868c-44e5603621a1 req-4535e69f-57e3-4e4f-9a42-5fdb0aad1daa service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:55.770591 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-790ac5a6-c5be-4970-868c-44e5603621a1 req-4535e69f-57e3-4e4f-9a42-5fdb0aad1daa service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:55.771274 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-790ac5a6-c5be-4970-868c-44e5603621a1 req-4535e69f-57e3-4e4f-9a42-5fdb0aad1daa service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:55.785047 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-790ac5a6-c5be-4970-868c-44e5603621a1 req-4535e69f-57e3-4e4f-9a42-5fdb0aad1daa service nova] Creating event network-vif-plugged:2e211122-d0c5-4c5f-9b31-8e606a42abd5 for instance 8f141686-0b27-4fd1-9e23-6634ade717ae on hv-cinder-83608 Sep 15 13:07:55.789918 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-790ac5a6-c5be-4970-868c-44e5603621a1 req-4535e69f-57e3-4e4f-9a42-5fdb0aad1daa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038163 Sep 15 13:07:55.790519 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 396/778] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:07:55.821948 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0f6213cc-4686-4171-8c44-71f2df1b7711 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:55.832050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0f6213cc-4686-4171-8c44-71f2df1b7711 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:55.834094 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0f6213cc-4686-4171-8c44-71f2df1b7711 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:55.835426 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0f6213cc-4686-4171-8c44-71f2df1b7711 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.173221 Sep 15 13:07:55.836151 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 383/779] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:55 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:55.937960 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-aaf8f596-d4b3-476c-8c81-6af34aa93eff tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:55.938664 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-aaf8f596-d4b3-476c-8c81-6af34aa93eff tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:55.944859 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aaf8f596-d4b3-476c-8c81-6af34aa93eff tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:55.945343 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aaf8f596-d4b3-476c-8c81-6af34aa93eff tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:55.945777 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aaf8f596-d4b3-476c-8c81-6af34aa93eff tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:55.946464 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aaf8f596-d4b3-476c-8c81-6af34aa93eff tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:55.946917 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aaf8f596-d4b3-476c-8c81-6af34aa93eff tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:55.947367 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aaf8f596-d4b3-476c-8c81-6af34aa93eff tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:56.095899 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-aaf8f596-d4b3-476c-8c81-6af34aa93eff tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:56.103864 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-aaf8f596-d4b3-476c-8c81-6af34aa93eff tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.170784 Sep 15 13:07:56.104467 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 397/780] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:07:55 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:07:56.861773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-83d4a601-f98d-4343-baac-d86d3cd7eaf1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:56.862380 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-83d4a601-f98d-4343-baac-d86d3cd7eaf1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:56.868732 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-83d4a601-f98d-4343-baac-d86d3cd7eaf1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:56.869208 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-83d4a601-f98d-4343-baac-d86d3cd7eaf1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:56.869636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-83d4a601-f98d-4343-baac-d86d3cd7eaf1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:56.870376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-83d4a601-f98d-4343-baac-d86d3cd7eaf1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:56.870825 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-83d4a601-f98d-4343-baac-d86d3cd7eaf1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:56.871240 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-83d4a601-f98d-4343-baac-d86d3cd7eaf1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:57.007003 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-83d4a601-f98d-4343-baac-d86d3cd7eaf1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:57.015094 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-83d4a601-f98d-4343-baac-d86d3cd7eaf1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:57.016565 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-83d4a601-f98d-4343-baac-d86d3cd7eaf1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:57.017722 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-83d4a601-f98d-4343-baac-d86d3cd7eaf1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.160020 Sep 15 13:07:57.018289 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 384/781] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:56 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:07:57.127383 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c50e69dc-6473-4e17-8095-094a091a16b7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:57.128104 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c50e69dc-6473-4e17-8095-094a091a16b7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:57.134688 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c50e69dc-6473-4e17-8095-094a091a16b7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:57.135239 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c50e69dc-6473-4e17-8095-094a091a16b7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:57.135671 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c50e69dc-6473-4e17-8095-094a091a16b7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:57.136403 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c50e69dc-6473-4e17-8095-094a091a16b7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:57.136849 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c50e69dc-6473-4e17-8095-094a091a16b7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:57.137262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c50e69dc-6473-4e17-8095-094a091a16b7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:57.273325 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c50e69dc-6473-4e17-8095-094a091a16b7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:57.281963 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c50e69dc-6473-4e17-8095-094a091a16b7 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.159565 Sep 15 13:07:57.282521 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 398/782] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:07:57 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:07:58.043432 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1b358474-34f8-4179-996e-958e1dc3ab75 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:58.044661 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1b358474-34f8-4179-996e-958e1dc3ab75 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:58.050931 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1b358474-34f8-4179-996e-958e1dc3ab75 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:58.051411 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1b358474-34f8-4179-996e-958e1dc3ab75 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:58.051846 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1b358474-34f8-4179-996e-958e1dc3ab75 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:58.052578 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1b358474-34f8-4179-996e-958e1dc3ab75 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:58.053013 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1b358474-34f8-4179-996e-958e1dc3ab75 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:58.053437 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1b358474-34f8-4179-996e-958e1dc3ab75 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:58.073377 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:58.189028 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1b358474-34f8-4179-996e-958e1dc3ab75 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:58.197008 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1b358474-34f8-4179-996e-958e1dc3ab75 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:58.198470 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-1b358474-34f8-4179-996e-958e1dc3ab75 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:58.199610 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1b358474-34f8-4179-996e-958e1dc3ab75 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.160171 Sep 15 13:07:58.200223 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 385/783] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:58 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:58.305029 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3159bd54-9b0b-4c45-b9f9-1915e97bfb8a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:58.305646 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3159bd54-9b0b-4c45-b9f9-1915e97bfb8a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:58.312995 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3159bd54-9b0b-4c45-b9f9-1915e97bfb8a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:58.313480 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3159bd54-9b0b-4c45-b9f9-1915e97bfb8a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:58.313912 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3159bd54-9b0b-4c45-b9f9-1915e97bfb8a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:58.314628 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3159bd54-9b0b-4c45-b9f9-1915e97bfb8a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:58.315080 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3159bd54-9b0b-4c45-b9f9-1915e97bfb8a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:58.315497 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3159bd54-9b0b-4c45-b9f9-1915e97bfb8a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:58.444023 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3159bd54-9b0b-4c45-b9f9-1915e97bfb8a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:58.452475 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3159bd54-9b0b-4c45-b9f9-1915e97bfb8a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.151194 Sep 15 13:07:58.453041 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 399/784] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:07:58 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:07:59.224915 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5991e4ab-e5db-4f8a-97e9-fdc933731358 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:59.225516 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5991e4ab-e5db-4f8a-97e9-fdc933731358 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:59.232851 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5991e4ab-e5db-4f8a-97e9-fdc933731358 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:59.233336 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5991e4ab-e5db-4f8a-97e9-fdc933731358 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:59.233781 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5991e4ab-e5db-4f8a-97e9-fdc933731358 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:59.234441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5991e4ab-e5db-4f8a-97e9-fdc933731358 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:59.234883 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5991e4ab-e5db-4f8a-97e9-fdc933731358 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:59.235295 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5991e4ab-e5db-4f8a-97e9-fdc933731358 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:59.363440 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5991e4ab-e5db-4f8a-97e9-fdc933731358 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:59.371363 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5991e4ab-e5db-4f8a-97e9-fdc933731358 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:59.373149 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5991e4ab-e5db-4f8a-97e9-fdc933731358 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:59.374302 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5991e4ab-e5db-4f8a-97e9-fdc933731358 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.153200 Sep 15 13:07:59.374843 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 386/785] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:07:59 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:07:59.475036 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e1fea119-8301-4bbe-ba7e-7e16d09ee340 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:07:59.475647 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e1fea119-8301-4bbe-ba7e-7e16d09ee340 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:07:59.482168 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e1fea119-8301-4bbe-ba7e-7e16d09ee340 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:59.482721 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e1fea119-8301-4bbe-ba7e-7e16d09ee340 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:59.483161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e1fea119-8301-4bbe-ba7e-7e16d09ee340 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:59.483846 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e1fea119-8301-4bbe-ba7e-7e16d09ee340 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:07:59.484318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e1fea119-8301-4bbe-ba7e-7e16d09ee340 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:07:59.484745 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e1fea119-8301-4bbe-ba7e-7e16d09ee340 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:07:59.614455 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e1fea119-8301-4bbe-ba7e-7e16d09ee340 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:07:59.622086 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e1fea119-8301-4bbe-ba7e-7e16d09ee340 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.151006 Sep 15 13:07:59.623015 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 400/786] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:07:59 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:00.400334 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4a30250d-8c53-433b-a11a-7134419dd12e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:00.400941 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-4a30250d-8c53-433b-a11a-7134419dd12e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:00.407273 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a30250d-8c53-433b-a11a-7134419dd12e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:00.407748 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a30250d-8c53-433b-a11a-7134419dd12e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:00.408177 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a30250d-8c53-433b-a11a-7134419dd12e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:00.408884 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a30250d-8c53-433b-a11a-7134419dd12e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:00.409323 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a30250d-8c53-433b-a11a-7134419dd12e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:00.409734 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a30250d-8c53-433b-a11a-7134419dd12e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:00.537171 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-4a30250d-8c53-433b-a11a-7134419dd12e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:00.545586 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-4a30250d-8c53-433b-a11a-7134419dd12e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:00.547030 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-4a30250d-8c53-433b-a11a-7134419dd12e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:00.548192 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-4a30250d-8c53-433b-a11a-7134419dd12e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.151966 Sep 15 13:08:00.548773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 387/787] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:08:00 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:08:00.645612 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-609f1ce7-cf6a-44a6-a937-9c693a22b025 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:00.646492 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-609f1ce7-cf6a-44a6-a937-9c693a22b025 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:00.652892 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-609f1ce7-cf6a-44a6-a937-9c693a22b025 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:00.654000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-609f1ce7-cf6a-44a6-a937-9c693a22b025 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:00.654628 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-609f1ce7-cf6a-44a6-a937-9c693a22b025 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:00.655326 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-609f1ce7-cf6a-44a6-a937-9c693a22b025 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:00.655785 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-609f1ce7-cf6a-44a6-a937-9c693a22b025 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:00.656212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-609f1ce7-cf6a-44a6-a937-9c693a22b025 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:00.786178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-609f1ce7-cf6a-44a6-a937-9c693a22b025 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:00.793803 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-609f1ce7-cf6a-44a6-a937-9c693a22b025 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.152074 Sep 15 13:08:00.794543 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 401/788] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:00 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:01.573158 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-cba52159-cee3-4f34-8cba-f27a1ea52448 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:01.573771 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-cba52159-cee3-4f34-8cba-f27a1ea52448 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:01.580197 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cba52159-cee3-4f34-8cba-f27a1ea52448 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:01.580714 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cba52159-cee3-4f34-8cba-f27a1ea52448 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:01.581149 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cba52159-cee3-4f34-8cba-f27a1ea52448 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:01.581833 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cba52159-cee3-4f34-8cba-f27a1ea52448 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:01.582281 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cba52159-cee3-4f34-8cba-f27a1ea52448 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:01.582700 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cba52159-cee3-4f34-8cba-f27a1ea52448 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:01.816915 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d3717a19-56d0-4e14-b054-b5ad138905e0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:01.817471 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d3717a19-56d0-4e14-b054-b5ad138905e0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:01.824759 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d3717a19-56d0-4e14-b054-b5ad138905e0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:01.825435 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d3717a19-56d0-4e14-b054-b5ad138905e0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:01.825879 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d3717a19-56d0-4e14-b054-b5ad138905e0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:01.826587 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d3717a19-56d0-4e14-b054-b5ad138905e0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:01.827071 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d3717a19-56d0-4e14-b054-b5ad138905e0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:01.827505 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d3717a19-56d0-4e14-b054-b5ad138905e0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:01.893447 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-cba52159-cee3-4f34-8cba-f27a1ea52448 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:01.901848 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-cba52159-cee3-4f34-8cba-f27a1ea52448 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:01.904243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-cba52159-cee3-4f34-8cba-f27a1ea52448 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:01.905634 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-cba52159-cee3-4f34-8cba-f27a1ea52448 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.336408 Sep 15 13:08:01.906432 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 388/789] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:08:01 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:08:01.939626 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-f003e08c-c03a-416f-b7c9-49b74c34773f req-e7c795b1-13cf-4bbd-918f-23e70ed62b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2628b91-c3d5-4bc0-88ed-c6786c051876", "name": "network-vif-unplugged", "status": "completed", "tag": "80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:08:01.970200 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-f003e08c-c03a-416f-b7c9-49b74c34773f req-e7c795b1-13cf-4bbd-918f-23e70ed62b7c service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:01.972318 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-f003e08c-c03a-416f-b7c9-49b74c34773f req-e7c795b1-13cf-4bbd-918f-23e70ed62b7c service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:01.972837 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-f003e08c-c03a-416f-b7c9-49b74c34773f req-e7c795b1-13cf-4bbd-918f-23e70ed62b7c service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:01.993624 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d3717a19-56d0-4e14-b054-b5ad138905e0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:02.000549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-f003e08c-c03a-416f-b7c9-49b74c34773f req-e7c795b1-13cf-4bbd-918f-23e70ed62b7c service nova] Creating event network-vif-unplugged:80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80 for instance e2628b91-c3d5-4bc0-88ed-c6786c051876 on hv-cinder-83608 Sep 15 13:08:02.005044 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d3717a19-56d0-4e14-b054-b5ad138905e0 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1571 microversion: 2.1 time: 0.192008 Sep 15 13:08:02.006156 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 402/790] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:01 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1571 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:08:02.011438 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-f003e08c-c03a-416f-b7c9-49b74c34773f req-e7c795b1-13cf-4bbd-918f-23e70ed62b7c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076405 Sep 15 13:08:02.012186 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 389/791] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:08:02.197339 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-73ed34be-ffb4-4e77-8422-c7b7144bef25 req-bfc6f455-0c46-4974-8b2f-f90ec4dd2dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2628b91-c3d5-4bc0-88ed-c6786c051876", "name": "network-vif-deleted", "tag": "80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:08:02.206861 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-73ed34be-ffb4-4e77-8422-c7b7144bef25 req-bfc6f455-0c46-4974-8b2f-f90ec4dd2dd7 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:02.207334 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-73ed34be-ffb4-4e77-8422-c7b7144bef25 req-bfc6f455-0c46-4974-8b2f-f90ec4dd2dd7 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:02.207753 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-73ed34be-ffb4-4e77-8422-c7b7144bef25 req-bfc6f455-0c46-4974-8b2f-f90ec4dd2dd7 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:02.219218 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-73ed34be-ffb4-4e77-8422-c7b7144bef25 req-bfc6f455-0c46-4974-8b2f-f90ec4dd2dd7 service nova] Creating event network-vif-deleted:80bb26e5-508e-4f6c-bb7b-28fcd7b8ab80 for instance e2628b91-c3d5-4bc0-88ed-c6786c051876 on hv-cinder-83608 Sep 15 13:08:02.223917 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-73ed34be-ffb4-4e77-8422-c7b7144bef25 req-bfc6f455-0c46-4974-8b2f-f90ec4dd2dd7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030349 Sep 15 13:08:02.224530 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 403/792] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:08:02.936585 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-97c65306-2e91-42eb-b388-672553a1ceb9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:02.937200 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-97c65306-2e91-42eb-b388-672553a1ceb9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:02.943336 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97c65306-2e91-42eb-b388-672553a1ceb9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:02.943824 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97c65306-2e91-42eb-b388-672553a1ceb9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:02.944313 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97c65306-2e91-42eb-b388-672553a1ceb9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:02.945007 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97c65306-2e91-42eb-b388-672553a1ceb9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:02.945487 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97c65306-2e91-42eb-b388-672553a1ceb9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:02.945907 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-97c65306-2e91-42eb-b388-672553a1ceb9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:03.034153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9acb85bc-5606-479e-86c3-d164b56c2b57 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:03.035595 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9acb85bc-5606-479e-86c3-d164b56c2b57 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:03.042734 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9acb85bc-5606-479e-86c3-d164b56c2b57 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:03.043328 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9acb85bc-5606-479e-86c3-d164b56c2b57 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:03.043807 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9acb85bc-5606-479e-86c3-d164b56c2b57 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:03.045074 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9acb85bc-5606-479e-86c3-d164b56c2b57 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:03.045718 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9acb85bc-5606-479e-86c3-d164b56c2b57 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:03.046399 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9acb85bc-5606-479e-86c3-d164b56c2b57 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:03.082590 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-97c65306-2e91-42eb-b388-672553a1ceb9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:03.094538 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-97c65306-2e91-42eb-b388-672553a1ceb9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:03.096588 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-97c65306-2e91-42eb-b388-672553a1ceb9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:03.098341 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-97c65306-2e91-42eb-b388-672553a1ceb9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1732 microversion: 2.20 time: 0.166669 Sep 15 13:08:03.099102 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 390/793] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:08:02 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:08:03.122970 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9acb85bc-5606-479e-86c3-d164b56c2b57 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '381e3962c4e24a599e720303e9be17e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6537f34327448c2b6acd5774dffc8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:03.131012 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9acb85bc-5606-479e-86c3-d164b56c2b57 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 200 len: 1220 microversion: 2.1 time: 0.101692 Sep 15 13:08:03.131622 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 404/794] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:03 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:08:03.508126 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-511fef97-74de-4f1c-859d-b97caee9dfdb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:03.510308 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-511fef97-74de-4f1c-859d-b97caee9dfdb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:03.516546 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-511fef97-74de-4f1c-859d-b97caee9dfdb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:03.517028 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-511fef97-74de-4f1c-859d-b97caee9dfdb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:03.517461 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-511fef97-74de-4f1c-859d-b97caee9dfdb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:03.518156 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-511fef97-74de-4f1c-859d-b97caee9dfdb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:03.518609 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-511fef97-74de-4f1c-859d-b97caee9dfdb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:03.519048 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-511fef97-74de-4f1c-859d-b97caee9dfdb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:03.550342 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-511fef97-74de-4f1c-859d-b97caee9dfdb tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046846 Sep 15 13:08:03.550958 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 391/795] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:08:03 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:08:03.564248 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-734a4e47-d35b-49b9-a954-d3d12c2f6f80 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:03.564799 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-734a4e47-d35b-49b9-a954-d3d12c2f6f80 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:03.570944 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-734a4e47-d35b-49b9-a954-d3d12c2f6f80 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:03.571398 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-734a4e47-d35b-49b9-a954-d3d12c2f6f80 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:03.571836 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-734a4e47-d35b-49b9-a954-d3d12c2f6f80 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:03.572574 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-734a4e47-d35b-49b9-a954-d3d12c2f6f80 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:03.573092 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-734a4e47-d35b-49b9-a954-d3d12c2f6f80 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:03.573461 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-734a4e47-d35b-49b9-a954-d3d12c2f6f80 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:03.602810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-734a4e47-d35b-49b9-a954-d3d12c2f6f80 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments/61046431-a9a7-4d98-bd8f-deaf0755bb07" status: 200 len: 194 microversion: 2.1 time: 0.043427 Sep 15 13:08:03.603776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 405/796] 10.222.0.57 () {58 vars in 1413 bytes} [Thu Sep 15 13:08:03 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments/61046431-a9a7-4d98-bd8f-deaf0755bb07 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:08:04.124293 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b5f95551-1728-4c10-a7a3-19d9af144521 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:04.125559 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b5f95551-1728-4c10-a7a3-19d9af144521 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:04.131990 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b5f95551-1728-4c10-a7a3-19d9af144521 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:04.132506 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b5f95551-1728-4c10-a7a3-19d9af144521 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:04.132941 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b5f95551-1728-4c10-a7a3-19d9af144521 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:04.133635 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b5f95551-1728-4c10-a7a3-19d9af144521 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:04.134090 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b5f95551-1728-4c10-a7a3-19d9af144521 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:04.134702 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b5f95551-1728-4c10-a7a3-19d9af144521 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:04.155522 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cc7e7539-887a-4323-9566-99416534144a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:04.156857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cc7e7539-887a-4323-9566-99416534144a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] [instance: e2628b91-c3d5-4bc0-88ed-c6786c051876] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:04.163850 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7e7539-887a-4323-9566-99416534144a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:04.164764 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7e7539-887a-4323-9566-99416534144a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:04.165445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7e7539-887a-4323-9566-99416534144a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:04.166263 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7e7539-887a-4323-9566-99416534144a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:04.166908 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7e7539-887a-4323-9566-99416534144a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:04.167425 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7e7539-887a-4323-9566-99416534144a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:04.184180 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-cc7e7539-887a-4323-9566-99416534144a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] HTTP exception thrown: Instance e2628b91-c3d5-4bc0-88ed-c6786c051876 could not be found. Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cc7e7539-887a-4323-9566-99416534144a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Request method failure captured: Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 HTTP/1.1 Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyJQ6LoAsCd8w-bBjqU-KvnNXcQOKOUTFsvxzyuRs3ZyF2t7DBDINewFU5AHAhjeqqQ0DWkBY2SW9RIueQjE-zqzqpLlUgl_3IVSU1OOr3nOKJ3HTW8ZnVN-ICrd33WS5BNePRa6Dj9Kwp8n9leWgi3OJi1ofQ7Kpcx2hARJTWtkK-Q Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: a6537f34327448c2b6acd5774dffc8c9 Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-TestShelveInstance-1876940609 Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:08:04.186344 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:08:04.188013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a6537f34327448c2b6acd5774dffc8c9", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a6537f34327448c2b6acd5774dffc8c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a6537f34327448c2b6acd5774dffc8c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a6537f34327448c2b6acd5774dffc8c9"}]}] Sep 15 13:08:04.188013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-TestShelveInstance-1876940609 Sep 15 13:08:04.188013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: a6537f34327448c2b6acd5774dffc8c9 Sep 15 13:08:04.188013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-TestShelveInstance-1876940609 Sep 15 13:08:04.188013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-TestShelveInstance-1876940609-project Sep 15 13:08:04.188013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:08:04.188013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:08:04.188013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 381e3962c4e24a599e720303e9be17e2 Sep 15 13:08:04.188013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-TestShelveInstance-1876940609-project Sep 15 13:08:04.188013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:08:04.188013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance e2628b91-c3d5-4bc0-88ed-c6786c051876 could not be found. Sep 15 13:08:04.188013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': 'e2628b91-c3d5-4bc0-88ed-c6786c051876'} Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2628b91-c3d5-4bc0-88ed-c6786c051876 could not be found. Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:08:04.188996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2628b91-c3d5-4bc0-88ed-c6786c051876 could not be found. Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2628b91-c3d5-4bc0-88ed-c6786c051876 could not be found. Sep 15 13:08:04.190517 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:04.192030 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cc7e7539-887a-4323-9566-99416534144a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Returning 404 to user: Instance e2628b91-c3d5-4bc0-88ed-c6786c051876 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:08:04.192030 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cc7e7539-887a-4323-9566-99416534144a tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876" status: 404 len: 111 microversion: 2.1 time: 0.037122 Sep 15 13:08:04.192030 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 406/797] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:04 2022] GET /compute/v2.1/servers/e2628b91-c3d5-4bc0-88ed-c6786c051876 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 13:08:04.279291 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b5f95551-1728-4c10-a7a3-19d9af144521 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:04.287562 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b5f95551-1728-4c10-a7a3-19d9af144521 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:04.289058 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b5f95551-1728-4c10-a7a3-19d9af144521 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:04.290201 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b5f95551-1728-4c10-a7a3-19d9af144521 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1719 microversion: 2.20 time: 0.171025 Sep 15 13:08:04.290762 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 392/798] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:08:04 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:08:04.354285 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-607a56be-e1a4-4cba-a039-cde63a638469 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] Calling method '.version_select at 0x7f62c5392670>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:04.390194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-607a56be-e1a4-4cba-a039-cde63a638469 tempest-TestShelveInstance-1876940609 tempest-TestShelveInstance-1876940609-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1061091117" status: 202 len: 0 microversion: 2.1 time: 0.042829 Sep 15 13:08:04.394269 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 407/799] 10.222.0.57 () {58 vars in 1254 bytes} [Thu Sep 15 13:08:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1061091117 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:08:04.962890 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b0c7055b-471c-4d48-b2a7-d6241ebf19fd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "136e9646-5832-4735-9420-0a1f9bd21157"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:08:04.965446 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b0c7055b-471c-4d48-b2a7-d6241ebf19fd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:04.971764 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b0c7055b-471c-4d48-b2a7-d6241ebf19fd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:04.972405 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b0c7055b-471c-4d48-b2a7-d6241ebf19fd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:04.972925 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b0c7055b-471c-4d48-b2a7-d6241ebf19fd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:04.973695 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b0c7055b-471c-4d48-b2a7-d6241ebf19fd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:04.974218 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b0c7055b-471c-4d48-b2a7-d6241ebf19fd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:04.974722 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b0c7055b-471c-4d48-b2a7-d6241ebf19fd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:05.242597 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b0c7055b-471c-4d48-b2a7-d6241ebf19fd tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "POST /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285849 Sep 15 13:08:05.243277 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 393/800] 10.222.0.57 () {60 vars in 1323 bytes} [Thu Sep 15 13:08:04 2022] POST /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:08:12.989603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e79bba64-3fc8-4964-b913-5af90bd7eff4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:12.991770 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e79bba64-3fc8-4964-b913-5af90bd7eff4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:12.993855 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:13.006781 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e79bba64-3fc8-4964-b913-5af90bd7eff4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:13.008255 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e79bba64-3fc8-4964-b913-5af90bd7eff4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:13.008763 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e79bba64-3fc8-4964-b913-5af90bd7eff4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:13.009494 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e79bba64-3fc8-4964-b913-5af90bd7eff4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:13.009955 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e79bba64-3fc8-4964-b913-5af90bd7eff4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:13.010385 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e79bba64-3fc8-4964-b913-5af90bd7eff4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:13.050986 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e79bba64-3fc8-4964-b913-5af90bd7eff4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.066849 Sep 15 13:08:13.052173 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 408/801] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:08:12 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:08:13.197526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ee2a5700-9dd0-404c-9a79-759cb8a3f8b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:13.198318 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ee2a5700-9dd0-404c-9a79-759cb8a3f8b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:13.200654 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:13.207102 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ee2a5700-9dd0-404c-9a79-759cb8a3f8b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:13.207689 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ee2a5700-9dd0-404c-9a79-759cb8a3f8b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:13.208546 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ee2a5700-9dd0-404c-9a79-759cb8a3f8b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:13.209376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ee2a5700-9dd0-404c-9a79-759cb8a3f8b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:13.209928 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ee2a5700-9dd0-404c-9a79-759cb8a3f8b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:13.210560 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ee2a5700-9dd0-404c-9a79-759cb8a3f8b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:13.244537 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ee2a5700-9dd0-404c-9a79-759cb8a3f8b4 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments/61046431-a9a7-4d98-bd8f-deaf0755bb07" status: 200 len: 194 microversion: 2.1 time: 0.052252 Sep 15 13:08:13.245240 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 394/802] 10.222.0.57 () {58 vars in 1413 bytes} [Thu Sep 15 13:08:13 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments/61046431-a9a7-4d98-bd8f-deaf0755bb07 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:08:13.257441 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d656cc3d-168d-4538-b6be-c29884541a40 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:13.258201 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d656cc3d-168d-4538-b6be-c29884541a40 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:13.264787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d656cc3d-168d-4538-b6be-c29884541a40 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:13.265411 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d656cc3d-168d-4538-b6be-c29884541a40 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:13.265983 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d656cc3d-168d-4538-b6be-c29884541a40 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:13.266790 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d656cc3d-168d-4538-b6be-c29884541a40 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:13.267478 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d656cc3d-168d-4538-b6be-c29884541a40 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:13.268007 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d656cc3d-168d-4538-b6be-c29884541a40 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:13.378823 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-d656cc3d-168d-4538-b6be-c29884541a40 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lazy-loading 'services' on Instance uuid 5890c2fe-0c31-40d0-a711-d783540d601c {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:08:13.489425 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d656cc3d-168d-4538-b6be-c29884541a40 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments/61046431-a9a7-4d98-bd8f-deaf0755bb07" status: 202 len: 0 microversion: 2.1 time: 0.237262 Sep 15 13:08:13.490778 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 409/803] 10.222.0.57 () {58 vars in 1416 bytes} [Thu Sep 15 13:08:13 2022] DELETE /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments/61046431-a9a7-4d98-bd8f-deaf0755bb07 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:08:15.716132 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6d363a77-fd80-4ac8-aa37-00cafcc431a9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:15.717444 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6d363a77-fd80-4ac8-aa37-00cafcc431a9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:15.724343 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d363a77-fd80-4ac8-aa37-00cafcc431a9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:15.725196 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d363a77-fd80-4ac8-aa37-00cafcc431a9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:15.725693 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d363a77-fd80-4ac8-aa37-00cafcc431a9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:15.726463 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d363a77-fd80-4ac8-aa37-00cafcc431a9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:15.727143 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d363a77-fd80-4ac8-aa37-00cafcc431a9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:15.727631 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d363a77-fd80-4ac8-aa37-00cafcc431a9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:15.760824 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6d363a77-fd80-4ac8-aa37-00cafcc431a9 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments/136e9646-5832-4735-9420-0a1f9bd21157" status: 200 len: 194 microversion: 2.1 time: 0.048977 Sep 15 13:08:15.761512 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 395/804] 10.222.0.57 () {58 vars in 1413 bytes} [Thu Sep 15 13:08:15 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments/136e9646-5832-4735-9420-0a1f9bd21157 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:08:15.773368 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9ac60c14-cbac-48c5-b888-db42d6caa362 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:15.774722 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9ac60c14-cbac-48c5-b888-db42d6caa362 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:15.783100 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9ac60c14-cbac-48c5-b888-db42d6caa362 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:15.783592 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9ac60c14-cbac-48c5-b888-db42d6caa362 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:15.784019 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9ac60c14-cbac-48c5-b888-db42d6caa362 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:15.784736 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9ac60c14-cbac-48c5-b888-db42d6caa362 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:15.785184 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9ac60c14-cbac-48c5-b888-db42d6caa362 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:15.785601 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9ac60c14-cbac-48c5-b888-db42d6caa362 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:15.897245 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-9ac60c14-cbac-48c5-b888-db42d6caa362 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lazy-loading 'services' on Instance uuid 5890c2fe-0c31-40d0-a711-d783540d601c {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:08:16.005111 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9ac60c14-cbac-48c5-b888-db42d6caa362 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments/136e9646-5832-4735-9420-0a1f9bd21157" status: 202 len: 0 microversion: 2.1 time: 0.235998 Sep 15 13:08:16.008511 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 410/805] 10.222.0.57 () {58 vars in 1416 bytes} [Thu Sep 15 13:08:15 2022] DELETE /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments/136e9646-5832-4735-9420-0a1f9bd21157 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:08:17.241107 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6baacf75-8c83-48db-a5a9-81735b85881d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:17.244029 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6baacf75-8c83-48db-a5a9-81735b85881d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:17.251531 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6baacf75-8c83-48db-a5a9-81735b85881d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:17.252323 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6baacf75-8c83-48db-a5a9-81735b85881d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:17.253005 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6baacf75-8c83-48db-a5a9-81735b85881d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:17.253943 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6baacf75-8c83-48db-a5a9-81735b85881d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:17.254636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6baacf75-8c83-48db-a5a9-81735b85881d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:17.255278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6baacf75-8c83-48db-a5a9-81735b85881d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:17.306297 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6baacf75-8c83-48db-a5a9-81735b85881d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068693 Sep 15 13:08:17.307868 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 396/806] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:08:17 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 13:08:17.479473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-fe9dba5b-caf2-4cf5-a9ad-de9264a478be tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:17.482845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-fe9dba5b-caf2-4cf5-a9ad-de9264a478be tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:17.489813 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe9dba5b-caf2-4cf5-a9ad-de9264a478be tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:17.492410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe9dba5b-caf2-4cf5-a9ad-de9264a478be tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:17.493020 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe9dba5b-caf2-4cf5-a9ad-de9264a478be tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:17.493875 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe9dba5b-caf2-4cf5-a9ad-de9264a478be tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:17.495591 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe9dba5b-caf2-4cf5-a9ad-de9264a478be tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:17.496862 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fe9dba5b-caf2-4cf5-a9ad-de9264a478be tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:17.596631 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-fe9dba5b-caf2-4cf5-a9ad-de9264a478be tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123008 Sep 15 13:08:17.599258 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 411/807] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:08:17 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 13:08:17.704948 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-eb380adb-7413-4fc5-ac61-d3f30dc89552 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:17.705458 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-eb380adb-7413-4fc5-ac61-d3f30dc89552 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:17.716625 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-eb380adb-7413-4fc5-ac61-d3f30dc89552 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:17.717126 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-eb380adb-7413-4fc5-ac61-d3f30dc89552 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:17.717566 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-eb380adb-7413-4fc5-ac61-d3f30dc89552 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:17.718282 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-eb380adb-7413-4fc5-ac61-d3f30dc89552 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:17.718743 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-eb380adb-7413-4fc5-ac61-d3f30dc89552 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:17.719171 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-eb380adb-7413-4fc5-ac61-d3f30dc89552 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:17.770283 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-eb380adb-7413-4fc5-ac61-d3f30dc89552 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Going to try to terminate instance {{(pid=120634) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:08:17.897706 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-eb380adb-7413-4fc5-ac61-d3f30dc89552 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 204 len: 0 microversion: 2.1 time: 0.195081 Sep 15 13:08:17.898504 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 397/808] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:08:17 2022] DELETE /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:08:17.908003 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3658d3f5-83be-4e09-811a-e5e07bf4187a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:17.910094 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3658d3f5-83be-4e09-811a-e5e07bf4187a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:17.921308 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3658d3f5-83be-4e09-811a-e5e07bf4187a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:17.922125 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3658d3f5-83be-4e09-811a-e5e07bf4187a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:17.922846 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3658d3f5-83be-4e09-811a-e5e07bf4187a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:17.923757 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3658d3f5-83be-4e09-811a-e5e07bf4187a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:17.925248 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3658d3f5-83be-4e09-811a-e5e07bf4187a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:17.925873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3658d3f5-83be-4e09-811a-e5e07bf4187a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:18.207324 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3658d3f5-83be-4e09-811a-e5e07bf4187a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:18.217722 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3658d3f5-83be-4e09-811a-e5e07bf4187a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1672 microversion: 2.1 time: 0.314373 Sep 15 13:08:18.218890 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 412/809] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:17 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1672 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:19.244977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6d6f3016-c83d-41c6-bfba-89f0bde86894 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:19.246326 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6d6f3016-c83d-41c6-bfba-89f0bde86894 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:19.253671 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d6f3016-c83d-41c6-bfba-89f0bde86894 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:19.254159 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d6f3016-c83d-41c6-bfba-89f0bde86894 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:19.254595 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d6f3016-c83d-41c6-bfba-89f0bde86894 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:19.255287 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d6f3016-c83d-41c6-bfba-89f0bde86894 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:19.255735 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d6f3016-c83d-41c6-bfba-89f0bde86894 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:19.256153 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6d6f3016-c83d-41c6-bfba-89f0bde86894 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:19.416095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6d6f3016-c83d-41c6-bfba-89f0bde86894 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:19.424894 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6d6f3016-c83d-41c6-bfba-89f0bde86894 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1672 microversion: 2.1 time: 0.185048 Sep 15 13:08:19.425478 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 398/810] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:19 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1672 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:20.448512 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8d6ece1c-76f5-46a7-96f4-5a94cd247396 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:20.449131 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-8d6ece1c-76f5-46a7-96f4-5a94cd247396 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:20.456636 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8d6ece1c-76f5-46a7-96f4-5a94cd247396 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:20.457378 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8d6ece1c-76f5-46a7-96f4-5a94cd247396 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:20.458013 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8d6ece1c-76f5-46a7-96f4-5a94cd247396 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:20.458911 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8d6ece1c-76f5-46a7-96f4-5a94cd247396 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:20.459529 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8d6ece1c-76f5-46a7-96f4-5a94cd247396 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:20.460116 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-8d6ece1c-76f5-46a7-96f4-5a94cd247396 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:20.688867 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-8d6ece1c-76f5-46a7-96f4-5a94cd247396 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:20.693897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:20.705329 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8d6ece1c-76f5-46a7-96f4-5a94cd247396 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1672 microversion: 2.1 time: 0.260596 Sep 15 13:08:20.705930 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 413/811] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:20 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1672 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:21.298961 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-be8cf86b-6b34-4640-977b-59e4941ccdb2 req-08a9d412-1ed4-4b05-a454-84d605f605ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5890c2fe-0c31-40d0-a711-d783540d601c", "name": "network-vif-deleted", "tag": "b747e91f-49be-4a75-ba8f-cd39089f132b"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:08:21.319503 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-be8cf86b-6b34-4640-977b-59e4941ccdb2 req-08a9d412-1ed4-4b05-a454-84d605f605ab service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:21.319985 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-be8cf86b-6b34-4640-977b-59e4941ccdb2 req-08a9d412-1ed4-4b05-a454-84d605f605ab service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:21.320463 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-be8cf86b-6b34-4640-977b-59e4941ccdb2 req-08a9d412-1ed4-4b05-a454-84d605f605ab service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:21.361899 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-be8cf86b-6b34-4640-977b-59e4941ccdb2 req-08a9d412-1ed4-4b05-a454-84d605f605ab service nova] Creating event network-vif-deleted:b747e91f-49be-4a75-ba8f-cd39089f132b for instance 5890c2fe-0c31-40d0-a711-d783540d601c on hv-cinder-83608 Sep 15 13:08:21.368474 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-be8cf86b-6b34-4640-977b-59e4941ccdb2 req-08a9d412-1ed4-4b05-a454-84d605f605ab service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077594 Sep 15 13:08:21.369685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 399/812] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:08:21.734989 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f564510d-1b0c-47c6-9bc8-d396ad7ff451 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:21.735603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f564510d-1b0c-47c6-9bc8-d396ad7ff451 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:21.747765 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f564510d-1b0c-47c6-9bc8-d396ad7ff451 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:21.748331 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f564510d-1b0c-47c6-9bc8-d396ad7ff451 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:21.751173 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f564510d-1b0c-47c6-9bc8-d396ad7ff451 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:21.751918 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f564510d-1b0c-47c6-9bc8-d396ad7ff451 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:21.752412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f564510d-1b0c-47c6-9bc8-d396ad7ff451 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:21.752830 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f564510d-1b0c-47c6-9bc8-d396ad7ff451 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:21.849660 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f564510d-1b0c-47c6-9bc8-d396ad7ff451 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:21.850461 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f564510d-1b0c-47c6-9bc8-d396ad7ff451 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:21.851181 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f564510d-1b0c-47c6-9bc8-d396ad7ff451 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:21.852479 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-f564510d-1b0c-47c6-9bc8-d396ad7ff451 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lazy-loading 'fault' on Instance uuid 5890c2fe-0c31-40d0-a711-d783540d601c {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:08:21.903729 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f564510d-1b0c-47c6-9bc8-d396ad7ff451 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff1145566f1408a9a22da9088581024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27776e610cf84b49af0fec4b95aa31f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:21.913907 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f564510d-1b0c-47c6-9bc8-d396ad7ff451 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 200 len: 1327 microversion: 2.1 time: 0.187810 Sep 15 13:08:21.917238 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 414/813] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:21 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 1327 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:22.971370 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fd81e8e2-8474-4390-80db-a17ced41db6c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:22.972854 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-fd81e8e2-8474-4390-80db-a17ced41db6c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:22.979582 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fd81e8e2-8474-4390-80db-a17ced41db6c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:22.985025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fd81e8e2-8474-4390-80db-a17ced41db6c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:22.987110 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fd81e8e2-8474-4390-80db-a17ced41db6c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:22.988058 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fd81e8e2-8474-4390-80db-a17ced41db6c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:22.988723 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fd81e8e2-8474-4390-80db-a17ced41db6c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:22.989465 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fd81e8e2-8474-4390-80db-a17ced41db6c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:23.006419 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-fd81e8e2-8474-4390-80db-a17ced41db6c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] HTTP exception thrown: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fd81e8e2-8474-4390-80db-a17ced41db6c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Request method failure captured: Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c HTTP/1.1 Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyF_HvhWG79Hexes3j0nPFKMSzaMlHwMn1bgsBBj7Nk70pYDgFfnYTVwa54-Vz2bEvRy1sJ19eqb5i_BZvDteyGukFrtDQlkFod7XYLeRyEQKeZqcadw47tSirWMeIebNL4k0p-QIWT6qpKviFxQZr6JBJFsU6Fuel_Xer36pEVnzYk Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 27776e610cf84b49af0fec4b95aa31f3 Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:08:23.008550 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:08:23.010205 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_27776e610cf84b49af0fec4b95aa31f3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/27776e610cf84b49af0fec4b95aa31f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/27776e610cf84b49af0fec4b95aa31f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/27776e610cf84b49af0fec4b95aa31f3"}]}] Sep 15 13:08:23.010205 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:23.010205 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 27776e610cf84b49af0fec4b95aa31f3 Sep 15 13:08:23.010205 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:23.010205 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-AttachVolumeTestJSON-651599207-project Sep 15 13:08:23.010205 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:08:23.010205 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:08:23.010205 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: cff1145566f1408a9a22da9088581024 Sep 15 13:08:23.010205 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-AttachVolumeTestJSON-651599207-project Sep 15 13:08:23.010205 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:08:23.010205 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:23.010205 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': '5890c2fe-0c31-40d0-a711-d783540d601c'} Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:08:23.011116 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:23.013485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:23.015829 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fd81e8e2-8474-4390-80db-a17ced41db6c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Returning 404 to user: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:08:23.016971 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-fd81e8e2-8474-4390-80db-a17ced41db6c tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 404 len: 111 microversion: 2.1 time: 0.058363 Sep 15 13:08:23.017756 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 400/814] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:22 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:08:23.026758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c2262e4f-0b68-4b4b-9b5e-8a01803abe40 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '.version_select at 0x7f62c53ad1f0>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:23.050623 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c2262e4f-0b68-4b4b-9b5e-8a01803abe40 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647303996" status: 202 len: 0 microversion: 2.1 time: 0.027897 Sep 15 13:08:23.051902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 415/815] 10.222.0.57 () {58 vars in 1221 bytes} [Thu Sep 15 13:08:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647303996 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:08:26.344008 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b229420b-cbb5-416f-8cee-822c925b3b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:26.344579 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b229420b-cbb5-416f-8cee-822c925b3b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:26.350592 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b229420b-cbb5-416f-8cee-822c925b3b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:26.351263 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b229420b-cbb5-416f-8cee-822c925b3b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:26.351882 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b229420b-cbb5-416f-8cee-822c925b3b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:26.352592 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b229420b-cbb5-416f-8cee-822c925b3b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:26.353195 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b229420b-cbb5-416f-8cee-822c925b3b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:26.353766 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b229420b-cbb5-416f-8cee-822c925b3b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:26.358909 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:26.370793 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-b229420b-cbb5-416f-8cee-822c925b3b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] HTTP exception thrown: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b229420b-cbb5-416f-8cee-822c925b3b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Request method failure captured: Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: DELETE /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c HTTP/1.1 Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyF_HvhWG79Hexes3j0nPFKMSzaMlHwMn1bgsBBj7Nk70pYDgFfnYTVwa54-Vz2bEvRy1sJ19eqb5i_BZvDteyGukFrtDQlkFod7XYLeRyEQKeZqcadw47tSirWMeIebNL4k0p-QIWT6qpKviFxQZr6JBJFsU6Fuel_Xer36pEVnzYk Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 27776e610cf84b49af0fec4b95aa31f3 Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:08:26.373012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:08:26.374593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_27776e610cf84b49af0fec4b95aa31f3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/27776e610cf84b49af0fec4b95aa31f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/27776e610cf84b49af0fec4b95aa31f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/27776e610cf84b49af0fec4b95aa31f3"}]}] Sep 15 13:08:26.374593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:26.374593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 27776e610cf84b49af0fec4b95aa31f3 Sep 15 13:08:26.374593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:26.374593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-AttachVolumeTestJSON-651599207-project Sep 15 13:08:26.374593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:08:26.374593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:08:26.374593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: cff1145566f1408a9a22da9088581024 Sep 15 13:08:26.374593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-AttachVolumeTestJSON-651599207-project Sep 15 13:08:26.374593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:08:26.374593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:26.374593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': '5890c2fe-0c31-40d0-a711-d783540d601c'} Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:08:26.375471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:26.376950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:26.381088 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b229420b-cbb5-416f-8cee-822c925b3b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Returning 404 to user: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:08:26.381088 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b229420b-cbb5-416f-8cee-822c925b3b84 tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 404 len: 111 microversion: 2.1 time: 0.034577 Sep 15 13:08:26.381088 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 401/816] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:08:26 2022] DELETE /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:08:26.384818 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-84dc194c-b23f-4cd8-ad87-8610cd8d88da tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:26.385567 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-84dc194c-b23f-4cd8-ad87-8610cd8d88da tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 5890c2fe-0c31-40d0-a711-d783540d601c] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:26.393960 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-84dc194c-b23f-4cd8-ad87-8610cd8d88da tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:26.394457 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-84dc194c-b23f-4cd8-ad87-8610cd8d88da tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:26.395194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-84dc194c-b23f-4cd8-ad87-8610cd8d88da tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:26.396214 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-84dc194c-b23f-4cd8-ad87-8610cd8d88da tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:26.396961 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-84dc194c-b23f-4cd8-ad87-8610cd8d88da tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:26.397390 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-84dc194c-b23f-4cd8-ad87-8610cd8d88da tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:26.412221 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-84dc194c-b23f-4cd8-ad87-8610cd8d88da tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] HTTP exception thrown: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-84dc194c-b23f-4cd8-ad87-8610cd8d88da tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Request method failure captured: Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c HTTP/1.1 Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyF_HvhWG79Hexes3j0nPFKMSzaMlHwMn1bgsBBj7Nk70pYDgFfnYTVwa54-Vz2bEvRy1sJ19eqb5i_BZvDteyGukFrtDQlkFod7XYLeRyEQKeZqcadw47tSirWMeIebNL4k0p-QIWT6qpKviFxQZr6JBJFsU6Fuel_Xer36pEVnzYk Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 27776e610cf84b49af0fec4b95aa31f3 Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:08:26.414056 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:08:26.415613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_27776e610cf84b49af0fec4b95aa31f3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/27776e610cf84b49af0fec4b95aa31f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/27776e610cf84b49af0fec4b95aa31f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/27776e610cf84b49af0fec4b95aa31f3"}]}] Sep 15 13:08:26.415613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:26.415613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 27776e610cf84b49af0fec4b95aa31f3 Sep 15 13:08:26.415613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:26.415613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeTestJSON-651599207-project Sep 15 13:08:26.415613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:08:26.415613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:08:26.415613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: cff1145566f1408a9a22da9088581024 Sep 15 13:08:26.415613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeTestJSON-651599207-project Sep 15 13:08:26.415613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:08:26.415613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:26.415613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '5890c2fe-0c31-40d0-a711-d783540d601c'} Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:08:26.416531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. Sep 15 13:08:26.417735 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:26.419352 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-84dc194c-b23f-4cd8-ad87-8610cd8d88da tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Returning 404 to user: Instance 5890c2fe-0c31-40d0-a711-d783540d601c could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:08:26.419352 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-84dc194c-b23f-4cd8-ad87-8610cd8d88da tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c" status: 404 len: 111 microversion: 2.1 time: 0.036049 Sep 15 13:08:26.419352 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 416/817] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:26 2022] GET /compute/v2.1/servers/5890c2fe-0c31-40d0-a711-d783540d601c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:08:27.573937 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6e2d20e8-e062-4be3-b938-99b8fc32c88d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:27.575140 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6e2d20e8-e062-4be3-b938-99b8fc32c88d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:27.582143 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6e2d20e8-e062-4be3-b938-99b8fc32c88d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:27.582889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6e2d20e8-e062-4be3-b938-99b8fc32c88d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:27.583413 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6e2d20e8-e062-4be3-b938-99b8fc32c88d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:27.584177 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6e2d20e8-e062-4be3-b938-99b8fc32c88d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:27.584711 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6e2d20e8-e062-4be3-b938-99b8fc32c88d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:27.585198 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6e2d20e8-e062-4be3-b938-99b8fc32c88d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:27.600698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-6e2d20e8-e062-4be3-b938-99b8fc32c88d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] HTTP exception thrown: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6e2d20e8-e062-4be3-b938-99b8fc32c88d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Request method failure captured: Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: DELETE /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 HTTP/1.1 Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyF_HvhWG79Hexes3j0nPFKMSzaMlHwMn1bgsBBj7Nk70pYDgFfnYTVwa54-Vz2bEvRy1sJ19eqb5i_BZvDteyGukFrtDQlkFod7XYLeRyEQKeZqcadw47tSirWMeIebNL4k0p-QIWT6qpKviFxQZr6JBJFsU6Fuel_Xer36pEVnzYk Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 27776e610cf84b49af0fec4b95aa31f3 Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:08:27.602628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:08:27.604462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_27776e610cf84b49af0fec4b95aa31f3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/27776e610cf84b49af0fec4b95aa31f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/27776e610cf84b49af0fec4b95aa31f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/27776e610cf84b49af0fec4b95aa31f3"}]}] Sep 15 13:08:27.604462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:27.604462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 27776e610cf84b49af0fec4b95aa31f3 Sep 15 13:08:27.604462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:27.604462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-AttachVolumeTestJSON-651599207-project Sep 15 13:08:27.604462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:08:27.604462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:08:27.604462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: cff1145566f1408a9a22da9088581024 Sep 15 13:08:27.604462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-AttachVolumeTestJSON-651599207-project Sep 15 13:08:27.604462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:08:27.604462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:08:27.604462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': '2c7538af-56ab-4022-85eb-172a1ee55d71'} Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:08:27.605360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:08:27.607036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:08:27.608861 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6e2d20e8-e062-4be3-b938-99b8fc32c88d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Returning 404 to user: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:08:27.608861 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6e2d20e8-e062-4be3-b938-99b8fc32c88d tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 404 len: 111 microversion: 2.1 time: 0.037722 Sep 15 13:08:27.609447 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 402/818] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:08:27 2022] DELETE /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:08:27.617810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-068e325b-d199-4e68-855d-15baae5ab18a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:27.619018 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-068e325b-d199-4e68-855d-15baae5ab18a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] [instance: 2c7538af-56ab-4022-85eb-172a1ee55d71] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:27.626996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-068e325b-d199-4e68-855d-15baae5ab18a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:27.627679 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-068e325b-d199-4e68-855d-15baae5ab18a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:27.628110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-068e325b-d199-4e68-855d-15baae5ab18a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:27.628834 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-068e325b-d199-4e68-855d-15baae5ab18a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:27.629288 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-068e325b-d199-4e68-855d-15baae5ab18a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:27.629825 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-068e325b-d199-4e68-855d-15baae5ab18a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:27.644979 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-068e325b-d199-4e68-855d-15baae5ab18a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] HTTP exception thrown: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-068e325b-d199-4e68-855d-15baae5ab18a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Request method failure captured: Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 HTTP/1.1 Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyF_HvhWG79Hexes3j0nPFKMSzaMlHwMn1bgsBBj7Nk70pYDgFfnYTVwa54-Vz2bEvRy1sJ19eqb5i_BZvDteyGukFrtDQlkFod7XYLeRyEQKeZqcadw47tSirWMeIebNL4k0p-QIWT6qpKviFxQZr6JBJFsU6Fuel_Xer36pEVnzYk Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 27776e610cf84b49af0fec4b95aa31f3 Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:08:27.647161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:08:27.648758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_27776e610cf84b49af0fec4b95aa31f3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/27776e610cf84b49af0fec4b95aa31f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/27776e610cf84b49af0fec4b95aa31f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/27776e610cf84b49af0fec4b95aa31f3"}]}] Sep 15 13:08:27.648758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:27.648758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 27776e610cf84b49af0fec4b95aa31f3 Sep 15 13:08:27.648758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeTestJSON-651599207 Sep 15 13:08:27.648758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeTestJSON-651599207-project Sep 15 13:08:27.648758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:08:27.648758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:08:27.648758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: cff1145566f1408a9a22da9088581024 Sep 15 13:08:27.648758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeTestJSON-651599207-project Sep 15 13:08:27.648758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:08:27.648758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:08:27.648758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '2c7538af-56ab-4022-85eb-172a1ee55d71'} Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:08:27.649717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. Sep 15 13:08:27.651153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:08:27.653456 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-068e325b-d199-4e68-855d-15baae5ab18a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] Returning 404 to user: Instance 2c7538af-56ab-4022-85eb-172a1ee55d71 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:08:27.654466 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-068e325b-d199-4e68-855d-15baae5ab18a tempest-AttachVolumeTestJSON-651599207 tempest-AttachVolumeTestJSON-651599207-project] 10.222.0.57 "GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71" status: 404 len: 111 microversion: 2.1 time: 0.040950 Sep 15 13:08:27.655166 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 417/819] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:27 2022] GET /compute/v2.1/servers/2c7538af-56ab-4022-85eb-172a1ee55d71 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:08:30.064196 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-dc471ef6-42d7-4c31-b95c-3a64b1f11601 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Action: 'create', calling method: .version_select at 0x7f62c54b00d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2034720126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCozHLaos4+mG9UCswgMzfcszr7ON2Xv2RPvfO8M8iOdLM+DIa7WcplxiSwHyfZHsZmQPhPv80AMMm9AsS7ENm5+0StenSp7QE/Ad7tcZSS9nhJfAaVo3MUghX2HzWVRnQ=="}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:08:30.084117 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-dc471ef6-42d7-4c31-b95c-3a64b1f11601 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Getting quotas for project 8b815e753bbe4a54942550a564653fd8. Resources: {'key_pairs'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:08:30.085107 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-dc471ef6-42d7-4c31-b95c-3a64b1f11601 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Getting quotas for user fd09d576051f4b98a8a9b3ec0ca18bc8 and project 8b815e753bbe4a54942550a564653fd8. Resources: {'key_pairs'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:08:30.113665 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-dc471ef6-42d7-4c31-b95c-3a64b1f11601 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053776 Sep 15 13:08:30.114812 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 403/820] 10.222.0.57 () {60 vars in 1159 bytes} [Thu Sep 15 13:08:30 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:08:30.167909 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-438486230", "imageRef": "62540f17-4b35-4a73-ada8-1bb07497858e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2034720126", "networks": [{"uuid": "e454855a-4089-44b0-8a85-e3102edffd8c"}]}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:08:30.378974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.network.neutron [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] validate_networks() for [('e454855a-4089-44b0-8a85-e3102edffd8c', None, None, None, None, None)] {{(pid=120633) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:08:31.007527 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Flavor limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:08:31.008019 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Image limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:08:31.008587 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Flavor pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:08:31.009012 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Image pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:08:31.009424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:08:31.020243 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:31.020989 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:31.021771 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:31.022511 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:31.022970 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:31.023398 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:31.041290 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Getting quotas for project 8b815e753bbe4a54942550a564653fd8. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:08:31.046820 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Getting quotas for user fd09d576051f4b98a8a9b3ec0ca18bc8 and project 8b815e753bbe4a54942550a564653fd8. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:08:31.060178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Going to run 1 instances... {{(pid=120633) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:08:31.066005 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='62540f17-4b35-4a73-ada8-1bb07497858e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:08:31.117020 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-50afbdfc-2cb2-40d6-8b16-e499d0b378f6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953033 Sep 15 13:08:31.117907 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 418/821] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:08:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 13:08:31.130678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-548ec470-3515-4ca3-a025-6e522aff2694 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:31.131281 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-548ec470-3515-4ca3-a025-6e522aff2694 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:31.275789 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-548ec470-3515-4ca3-a025-6e522aff2694 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:31.284175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-548ec470-3515-4ca3-a025-6e522aff2694 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1258 microversion: 2.1 time: 0.157858 Sep 15 13:08:31.284835 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 404/822] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:31 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:32.310873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-941cec7b-8c63-4f92-b361-8782ed46aa36 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:32.311597 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-941cec7b-8c63-4f92-b361-8782ed46aa36 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:32.318126 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-941cec7b-8c63-4f92-b361-8782ed46aa36 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:32.318618 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-941cec7b-8c63-4f92-b361-8782ed46aa36 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:32.319055 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-941cec7b-8c63-4f92-b361-8782ed46aa36 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:32.319753 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-941cec7b-8c63-4f92-b361-8782ed46aa36 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:32.320247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-941cec7b-8c63-4f92-b361-8782ed46aa36 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:32.320645 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-941cec7b-8c63-4f92-b361-8782ed46aa36 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:32.393664 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-941cec7b-8c63-4f92-b361-8782ed46aa36 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:32.403329 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-941cec7b-8c63-4f92-b361-8782ed46aa36 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1310 microversion: 2.1 time: 0.096746 Sep 15 13:08:32.404394 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 419/823] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:32 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1310 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:33.427091 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0d03b03b-8807-46c4-83b6-26e5a497cdd3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:33.428039 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0d03b03b-8807-46c4-83b6-26e5a497cdd3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:33.450372 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0d03b03b-8807-46c4-83b6-26e5a497cdd3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:33.452028 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0d03b03b-8807-46c4-83b6-26e5a497cdd3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:33.453151 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0d03b03b-8807-46c4-83b6-26e5a497cdd3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:33.455585 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0d03b03b-8807-46c4-83b6-26e5a497cdd3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:33.456315 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0d03b03b-8807-46c4-83b6-26e5a497cdd3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:33.457541 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0d03b03b-8807-46c4-83b6-26e5a497cdd3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:33.818392 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0d03b03b-8807-46c4-83b6-26e5a497cdd3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:33.832478 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0d03b03b-8807-46c4-83b6-26e5a497cdd3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.409285 Sep 15 13:08:33.839385 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 405/824] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:33 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:34.335553 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-55e003d3-423c-4e74-95a8-27231ed4fece req-f52de98c-9b11-4302-8d97-d34973f91854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6fe9060-6085-4ae1-90d1-dc0ed730c243", "tag": "8664056d-9981-4374-9627-df05e9500424"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:08:34.356312 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-55e003d3-423c-4e74-95a8-27231ed4fece req-f52de98c-9b11-4302-8d97-d34973f91854 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:34.356893 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-55e003d3-423c-4e74-95a8-27231ed4fece req-f52de98c-9b11-4302-8d97-d34973f91854 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:34.367808 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-55e003d3-423c-4e74-95a8-27231ed4fece req-f52de98c-9b11-4302-8d97-d34973f91854 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:34.391841 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-55e003d3-423c-4e74-95a8-27231ed4fece req-f52de98c-9b11-4302-8d97-d34973f91854 service nova] Creating event network-changed:8664056d-9981-4374-9627-df05e9500424 for instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 on hv-cinder-83608 Sep 15 13:08:34.397665 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-55e003d3-423c-4e74-95a8-27231ed4fece req-f52de98c-9b11-4302-8d97-d34973f91854 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067523 Sep 15 13:08:34.398780 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 420/825] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:08:34.873526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-7c12da87-7f89-476c-8ff6-9feb899a35ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:34.874581 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-7c12da87-7f89-476c-8ff6-9feb899a35ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:34.881343 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c12da87-7f89-476c-8ff6-9feb899a35ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:34.881866 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c12da87-7f89-476c-8ff6-9feb899a35ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:34.882302 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c12da87-7f89-476c-8ff6-9feb899a35ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:34.883004 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c12da87-7f89-476c-8ff6-9feb899a35ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:34.883453 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c12da87-7f89-476c-8ff6-9feb899a35ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:34.883871 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7c12da87-7f89-476c-8ff6-9feb899a35ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:35.050628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-7c12da87-7f89-476c-8ff6-9feb899a35ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:35.060358 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-7c12da87-7f89-476c-8ff6-9feb899a35ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.196338 Sep 15 13:08:35.061347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 406/826] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:34 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:36.087230 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3573ee42-09a9-42ed-9379-0bff4d339c2e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:36.088312 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3573ee42-09a9-42ed-9379-0bff4d339c2e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:36.101250 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3573ee42-09a9-42ed-9379-0bff4d339c2e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:36.101746 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3573ee42-09a9-42ed-9379-0bff4d339c2e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:36.102178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3573ee42-09a9-42ed-9379-0bff4d339c2e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:36.102889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3573ee42-09a9-42ed-9379-0bff4d339c2e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:36.103340 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3573ee42-09a9-42ed-9379-0bff4d339c2e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:36.103825 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3573ee42-09a9-42ed-9379-0bff4d339c2e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:36.267935 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3573ee42-09a9-42ed-9379-0bff4d339c2e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:36.281335 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3573ee42-09a9-42ed-9379-0bff4d339c2e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.198555 Sep 15 13:08:36.282508 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 421/827] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:36 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:37.306372 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a76649d9-2263-44a2-b9d5-1b759eee0155 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:37.306985 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a76649d9-2263-44a2-b9d5-1b759eee0155 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:37.315678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a76649d9-2263-44a2-b9d5-1b759eee0155 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:37.316667 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a76649d9-2263-44a2-b9d5-1b759eee0155 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:37.317442 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a76649d9-2263-44a2-b9d5-1b759eee0155 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:37.318108 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a76649d9-2263-44a2-b9d5-1b759eee0155 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:37.322073 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a76649d9-2263-44a2-b9d5-1b759eee0155 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:37.322617 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a76649d9-2263-44a2-b9d5-1b759eee0155 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:37.520174 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a76649d9-2263-44a2-b9d5-1b759eee0155 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:37.531222 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a76649d9-2263-44a2-b9d5-1b759eee0155 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.229942 Sep 15 13:08:37.532018 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 407/828] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:37 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:38.554518 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-1ffc0277-7eaf-4ac1-b36c-d6acd5aefe15 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:38.556006 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-1ffc0277-7eaf-4ac1-b36c-d6acd5aefe15 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:38.562710 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1ffc0277-7eaf-4ac1-b36c-d6acd5aefe15 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:38.563197 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1ffc0277-7eaf-4ac1-b36c-d6acd5aefe15 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:38.563653 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1ffc0277-7eaf-4ac1-b36c-d6acd5aefe15 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:38.564379 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1ffc0277-7eaf-4ac1-b36c-d6acd5aefe15 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:38.565026 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1ffc0277-7eaf-4ac1-b36c-d6acd5aefe15 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:38.565617 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1ffc0277-7eaf-4ac1-b36c-d6acd5aefe15 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:38.710572 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-1ffc0277-7eaf-4ac1-b36c-d6acd5aefe15 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:38.723254 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-1ffc0277-7eaf-4ac1-b36c-d6acd5aefe15 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.172326 Sep 15 13:08:38.723881 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 422/829] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:38 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:39.746041 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-7439ccae-162a-4d6c-b7ad-5f1a31450b1e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:39.748032 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-7439ccae-162a-4d6c-b7ad-5f1a31450b1e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:39.756005 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7439ccae-162a-4d6c-b7ad-5f1a31450b1e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:39.757096 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7439ccae-162a-4d6c-b7ad-5f1a31450b1e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:39.757802 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7439ccae-162a-4d6c-b7ad-5f1a31450b1e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:39.758714 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7439ccae-162a-4d6c-b7ad-5f1a31450b1e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:39.759221 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7439ccae-162a-4d6c-b7ad-5f1a31450b1e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:39.759638 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7439ccae-162a-4d6c-b7ad-5f1a31450b1e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:39.925961 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-7439ccae-162a-4d6c-b7ad-5f1a31450b1e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:39.934834 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-7439ccae-162a-4d6c-b7ad-5f1a31450b1e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.192695 Sep 15 13:08:39.936743 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 408/830] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:39 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:40.038584 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0840dceb-ba3b-4164-a4d6-3f32c0a59a3d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:40.039741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0840dceb-ba3b-4164-a4d6-3f32c0a59a3d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:40.047660 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0840dceb-ba3b-4164-a4d6-3f32c0a59a3d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:40.048824 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0840dceb-ba3b-4164-a4d6-3f32c0a59a3d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:40.049699 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0840dceb-ba3b-4164-a4d6-3f32c0a59a3d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:40.050394 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0840dceb-ba3b-4164-a4d6-3f32c0a59a3d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:40.050858 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0840dceb-ba3b-4164-a4d6-3f32c0a59a3d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:40.051956 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0840dceb-ba3b-4164-a4d6-3f32c0a59a3d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:40.077624 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0840dceb-ba3b-4164-a4d6-3f32c0a59a3d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/ips" status: 200 len: 150 microversion: 2.1 time: 0.042915 Sep 15 13:08:40.084674 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 423/831] 10.222.0.57 () {58 vars in 1248 bytes} [Thu Sep 15 13:08:40 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:08:40.958619 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-bf33c745-1f29-477b-be43-c836e517af62 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:40.960146 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-bf33c745-1f29-477b-be43-c836e517af62 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:40.967811 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bf33c745-1f29-477b-be43-c836e517af62 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:40.968425 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bf33c745-1f29-477b-be43-c836e517af62 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:40.968922 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bf33c745-1f29-477b-be43-c836e517af62 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:40.969717 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bf33c745-1f29-477b-be43-c836e517af62 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:40.970340 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bf33c745-1f29-477b-be43-c836e517af62 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:40.970956 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bf33c745-1f29-477b-be43-c836e517af62 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:41.142502 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-bf33c745-1f29-477b-be43-c836e517af62 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:41.151813 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-bf33c745-1f29-477b-be43-c836e517af62 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.198571 Sep 15 13:08:41.153790 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 409/832] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:40 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:41.475921 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0e893222-a859-4bdf-9a28-dc4d226d974a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c84db7c-cfb7-47a7-94a6-8aeafe699714"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:08:41.479639 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0e893222-a859-4bdf-9a28-dc4d226d974a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:41.483173 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:41.484606 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=6 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:41.488865 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0e893222-a859-4bdf-9a28-dc4d226d974a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:41.489580 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0e893222-a859-4bdf-9a28-dc4d226d974a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:41.490085 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0e893222-a859-4bdf-9a28-dc4d226d974a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:41.490871 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0e893222-a859-4bdf-9a28-dc4d226d974a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:41.491397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0e893222-a859-4bdf-9a28-dc4d226d974a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:41.491896 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0e893222-a859-4bdf-9a28-dc4d226d974a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:42.177627 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5c606da4-e7d7-43c0-a954-e84ffd1636ce tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:42.178179 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5c606da4-e7d7-43c0-a954-e84ffd1636ce tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:42.179995 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=6 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:42.186446 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5c606da4-e7d7-43c0-a954-e84ffd1636ce tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:42.187268 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5c606da4-e7d7-43c0-a954-e84ffd1636ce tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:42.187771 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5c606da4-e7d7-43c0-a954-e84ffd1636ce tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:42.188563 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5c606da4-e7d7-43c0-a954-e84ffd1636ce tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:42.189072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5c606da4-e7d7-43c0-a954-e84ffd1636ce tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:42.189493 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5c606da4-e7d7-43c0-a954-e84ffd1636ce tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:42.324920 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5c606da4-e7d7-43c0-a954-e84ffd1636ce tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:42.332733 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5c606da4-e7d7-43c0-a954-e84ffd1636ce tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.159100 Sep 15 13:08:42.333302 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 410/833] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:42 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:08:43.357580 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e5c8bb9e-2ce7-4479-9c72-8be1e2499f0e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:43.358214 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-e5c8bb9e-2ce7-4479-9c72-8be1e2499f0e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:43.360467 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:43.366182 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e5c8bb9e-2ce7-4479-9c72-8be1e2499f0e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:43.366663 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e5c8bb9e-2ce7-4479-9c72-8be1e2499f0e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:43.367095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e5c8bb9e-2ce7-4479-9c72-8be1e2499f0e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:43.367780 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e5c8bb9e-2ce7-4479-9c72-8be1e2499f0e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:43.368231 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e5c8bb9e-2ce7-4479-9c72-8be1e2499f0e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:43.368678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e5c8bb9e-2ce7-4479-9c72-8be1e2499f0e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:43.500230 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e5c8bb9e-2ce7-4479-9c72-8be1e2499f0e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:43.507875 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e5c8bb9e-2ce7-4479-9c72-8be1e2499f0e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.154131 Sep 15 13:08:43.508398 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 411/834] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:43 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:08:44.531702 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-44987f26-c2b1-43aa-be8d-51397a0a033b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:44.532835 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-44987f26-c2b1-43aa-be8d-51397a0a033b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:44.539472 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-44987f26-c2b1-43aa-be8d-51397a0a033b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:44.539951 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-44987f26-c2b1-43aa-be8d-51397a0a033b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:44.540418 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-44987f26-c2b1-43aa-be8d-51397a0a033b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:44.541104 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-44987f26-c2b1-43aa-be8d-51397a0a033b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:44.541546 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-44987f26-c2b1-43aa-be8d-51397a0a033b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:44.541960 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-44987f26-c2b1-43aa-be8d-51397a0a033b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:44.668338 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-44987f26-c2b1-43aa-be8d-51397a0a033b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:44.676800 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-44987f26-c2b1-43aa-be8d-51397a0a033b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.150218 Sep 15 13:08:44.677366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 412/835] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:44 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:08:45.699897 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a55930f5-8cbb-46c1-a4dd-42d017cce835 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:45.701781 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a55930f5-8cbb-46c1-a4dd-42d017cce835 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:45.708745 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a55930f5-8cbb-46c1-a4dd-42d017cce835 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:45.709258 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a55930f5-8cbb-46c1-a4dd-42d017cce835 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:45.709697 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a55930f5-8cbb-46c1-a4dd-42d017cce835 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:45.710389 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a55930f5-8cbb-46c1-a4dd-42d017cce835 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:45.710840 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a55930f5-8cbb-46c1-a4dd-42d017cce835 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:45.711259 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a55930f5-8cbb-46c1-a4dd-42d017cce835 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:45.849031 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a55930f5-8cbb-46c1-a4dd-42d017cce835 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:45.857529 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a55930f5-8cbb-46c1-a4dd-42d017cce835 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.161740 Sep 15 13:08:45.858103 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 413/836] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:45 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:08:46.880163 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-afdcb9a9-1228-46f2-8da2-adf914e5ed3b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:46.880856 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-afdcb9a9-1228-46f2-8da2-adf914e5ed3b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:46.887236 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-afdcb9a9-1228-46f2-8da2-adf914e5ed3b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:46.887726 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-afdcb9a9-1228-46f2-8da2-adf914e5ed3b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:46.888819 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-afdcb9a9-1228-46f2-8da2-adf914e5ed3b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:46.889526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-afdcb9a9-1228-46f2-8da2-adf914e5ed3b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:46.889975 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-afdcb9a9-1228-46f2-8da2-adf914e5ed3b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:46.890402 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-afdcb9a9-1228-46f2-8da2-adf914e5ed3b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:47.016685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-afdcb9a9-1228-46f2-8da2-adf914e5ed3b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:47.024651 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-afdcb9a9-1228-46f2-8da2-adf914e5ed3b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.148238 Sep 15 13:08:47.025225 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 414/837] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:46 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:08:48.049137 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-38eb59ed-220f-4896-b8a7-7762193d09e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:48.049773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-38eb59ed-220f-4896-b8a7-7762193d09e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:48.056197 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-38eb59ed-220f-4896-b8a7-7762193d09e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:48.056707 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-38eb59ed-220f-4896-b8a7-7762193d09e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:48.057135 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-38eb59ed-220f-4896-b8a7-7762193d09e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:48.057810 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-38eb59ed-220f-4896-b8a7-7762193d09e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:48.058252 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-38eb59ed-220f-4896-b8a7-7762193d09e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:48.058662 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-38eb59ed-220f-4896-b8a7-7762193d09e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:48.190290 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-38eb59ed-220f-4896-b8a7-7762193d09e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:48.197989 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-38eb59ed-220f-4896-b8a7-7762193d09e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.152781 Sep 15 13:08:48.198557 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 415/838] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:48 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:08:48.506025 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0e893222-a859-4bdf-9a28-dc4d226d974a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "POST /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.033876 Sep 15 13:08:48.506625 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 424/839] 10.222.0.57 () {60 vars in 1323 bytes} [Thu Sep 15 13:08:41 2022] POST /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/os-volume_attachments => generated 194 bytes in 7035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:08:49.222300 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-9c6d521c-0c2f-41e4-825b-b51e562b4427 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:49.222834 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-9c6d521c-0c2f-41e4-825b-b51e562b4427 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:49.229511 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9c6d521c-0c2f-41e4-825b-b51e562b4427 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:49.230005 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9c6d521c-0c2f-41e4-825b-b51e562b4427 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:49.230514 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9c6d521c-0c2f-41e4-825b-b51e562b4427 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:49.231339 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9c6d521c-0c2f-41e4-825b-b51e562b4427 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:49.232390 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9c6d521c-0c2f-41e4-825b-b51e562b4427 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:49.233171 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9c6d521c-0c2f-41e4-825b-b51e562b4427 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:49.620853 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9c6d521c-0c2f-41e4-825b-b51e562b4427 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:49.629120 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-9c6d521c-0c2f-41e4-825b-b51e562b4427 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.411266 Sep 15 13:08:49.646308 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 416/840] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:49 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:50.653983 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-599a9c9d-7d9a-4c88-8691-5c4979a67d07 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:50.654677 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-599a9c9d-7d9a-4c88-8691-5c4979a67d07 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:50.656637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:50.663030 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-599a9c9d-7d9a-4c88-8691-5c4979a67d07 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:50.663520 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-599a9c9d-7d9a-4c88-8691-5c4979a67d07 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:50.663955 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-599a9c9d-7d9a-4c88-8691-5c4979a67d07 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:50.664686 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-599a9c9d-7d9a-4c88-8691-5c4979a67d07 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:50.665143 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-599a9c9d-7d9a-4c88-8691-5c4979a67d07 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:50.665571 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-599a9c9d-7d9a-4c88-8691-5c4979a67d07 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:50.794890 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-599a9c9d-7d9a-4c88-8691-5c4979a67d07 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:50.802561 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-599a9c9d-7d9a-4c88-8691-5c4979a67d07 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.153452 Sep 15 13:08:50.803115 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 425/841] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:50 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:51.825447 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-453bcbe1-e80a-4f17-888d-c030b5bf5aa5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:51.826004 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-453bcbe1-e80a-4f17-888d-c030b5bf5aa5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:51.832813 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-453bcbe1-e80a-4f17-888d-c030b5bf5aa5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:51.833302 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-453bcbe1-e80a-4f17-888d-c030b5bf5aa5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:51.833736 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-453bcbe1-e80a-4f17-888d-c030b5bf5aa5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:51.834430 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-453bcbe1-e80a-4f17-888d-c030b5bf5aa5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:51.834883 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-453bcbe1-e80a-4f17-888d-c030b5bf5aa5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:51.835306 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-453bcbe1-e80a-4f17-888d-c030b5bf5aa5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:51.969049 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-453bcbe1-e80a-4f17-888d-c030b5bf5aa5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:51.976515 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-453bcbe1-e80a-4f17-888d-c030b5bf5aa5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.155010 Sep 15 13:08:51.977083 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 417/842] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:51 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:52.999127 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-1e409e74-d4cf-4ae2-b649-ca3a45e40ced tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:52.999742 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-1e409e74-d4cf-4ae2-b649-ca3a45e40ced tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:53.006709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1e409e74-d4cf-4ae2-b649-ca3a45e40ced tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:53.007183 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1e409e74-d4cf-4ae2-b649-ca3a45e40ced tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:53.007620 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1e409e74-d4cf-4ae2-b649-ca3a45e40ced tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:53.008404 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1e409e74-d4cf-4ae2-b649-ca3a45e40ced tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:53.008865 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1e409e74-d4cf-4ae2-b649-ca3a45e40ced tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:53.009286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1e409e74-d4cf-4ae2-b649-ca3a45e40ced tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:53.013317 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:53.149161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-1e409e74-d4cf-4ae2-b649-ca3a45e40ced tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:53.158133 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-1e409e74-d4cf-4ae2-b649-ca3a45e40ced tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.162961 Sep 15 13:08:53.158712 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 426/843] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:52 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:08:54.180488 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ebc7562d-4cf8-4ba6-b915-f0ee528d56b6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:54.181113 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ebc7562d-4cf8-4ba6-b915-f0ee528d56b6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:54.188002 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ebc7562d-4cf8-4ba6-b915-f0ee528d56b6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:54.188537 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ebc7562d-4cf8-4ba6-b915-f0ee528d56b6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:54.188977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ebc7562d-4cf8-4ba6-b915-f0ee528d56b6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:54.189677 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ebc7562d-4cf8-4ba6-b915-f0ee528d56b6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:54.190129 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ebc7562d-4cf8-4ba6-b915-f0ee528d56b6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:54.190656 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ebc7562d-4cf8-4ba6-b915-f0ee528d56b6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:54.336903 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ebc7562d-4cf8-4ba6-b915-f0ee528d56b6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:54.346102 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ebc7562d-4cf8-4ba6-b915-f0ee528d56b6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.169785 Sep 15 13:08:54.346675 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 418/844] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:54 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:08:55.370211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-fd9ad313-85aa-4b39-b974-bc58a84145b3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:55.370756 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-fd9ad313-85aa-4b39-b974-bc58a84145b3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:55.378265 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fd9ad313-85aa-4b39-b974-bc58a84145b3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:55.378752 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fd9ad313-85aa-4b39-b974-bc58a84145b3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:55.379187 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fd9ad313-85aa-4b39-b974-bc58a84145b3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:55.379903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fd9ad313-85aa-4b39-b974-bc58a84145b3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:55.380397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fd9ad313-85aa-4b39-b974-bc58a84145b3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:55.380825 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fd9ad313-85aa-4b39-b974-bc58a84145b3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:55.511220 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-fd9ad313-85aa-4b39-b974-bc58a84145b3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:55.520507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-fd9ad313-85aa-4b39-b974-bc58a84145b3 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.155156 Sep 15 13:08:55.521099 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 427/845] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:55 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:56.194355 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e4681832-3ffd-49b4-8a81-ad47f3fd1ea7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:56.195101 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-e4681832-3ffd-49b4-8a81-ad47f3fd1ea7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:56.201872 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e4681832-3ffd-49b4-8a81-ad47f3fd1ea7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:56.202355 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e4681832-3ffd-49b4-8a81-ad47f3fd1ea7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:56.202784 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e4681832-3ffd-49b4-8a81-ad47f3fd1ea7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:56.203468 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e4681832-3ffd-49b4-8a81-ad47f3fd1ea7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:56.203939 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e4681832-3ffd-49b4-8a81-ad47f3fd1ea7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:56.204378 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e4681832-3ffd-49b4-8a81-ad47f3fd1ea7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:56.216165 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-e58819b1-024c-4f53-aa81-e4f412c8320c req-9cca5c62-49c0-4080-a5b3-8f6d92435860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6fe9060-6085-4ae1-90d1-dc0ed730c243", "name": "network-vif-plugged", "status": "completed", "tag": "8664056d-9981-4374-9627-df05e9500424"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:08:56.227059 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e58819b1-024c-4f53-aa81-e4f412c8320c req-9cca5c62-49c0-4080-a5b3-8f6d92435860 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:56.227552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e58819b1-024c-4f53-aa81-e4f412c8320c req-9cca5c62-49c0-4080-a5b3-8f6d92435860 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:56.227987 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e58819b1-024c-4f53-aa81-e4f412c8320c req-9cca5c62-49c0-4080-a5b3-8f6d92435860 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:56.241850 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-e58819b1-024c-4f53-aa81-e4f412c8320c req-9cca5c62-49c0-4080-a5b3-8f6d92435860 service nova] Creating event network-vif-plugged:8664056d-9981-4374-9627-df05e9500424 for instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 on hv-cinder-83608 Sep 15 13:08:56.247010 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-e58819b1-024c-4f53-aa81-e4f412c8320c req-9cca5c62-49c0-4080-a5b3-8f6d92435860 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034811 Sep 15 13:08:56.249757 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 428/846] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:08:56.315323 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-e4681832-3ffd-49b4-8a81-ad47f3fd1ea7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lazy-loading 'services' on Instance uuid fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:08:56.396842 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e4681832-3ffd-49b4-8a81-ad47f3fd1ea7 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/os-volume_attachments/2c84db7c-cfb7-47a7-94a6-8aeafe699714" status: 202 len: 0 microversion: 2.1 time: 0.205977 Sep 15 13:08:56.397427 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 419/847] 10.222.0.57 () {58 vars in 1416 bytes} [Thu Sep 15 13:08:56 2022] DELETE /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/os-volume_attachments/2c84db7c-cfb7-47a7-94a6-8aeafe699714 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:08:56.407296 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7f00bf7f-fca8-41b2-97e6-23deab9b3a91 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:56.410596 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7f00bf7f-fca8-41b2-97e6-23deab9b3a91 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:56.418223 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7f00bf7f-fca8-41b2-97e6-23deab9b3a91 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:56.418712 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7f00bf7f-fca8-41b2-97e6-23deab9b3a91 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:56.420115 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7f00bf7f-fca8-41b2-97e6-23deab9b3a91 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:56.420999 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7f00bf7f-fca8-41b2-97e6-23deab9b3a91 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:56.421464 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7f00bf7f-fca8-41b2-97e6-23deab9b3a91 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:56.421883 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7f00bf7f-fca8-41b2-97e6-23deab9b3a91 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:56.464077 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7f00bf7f-fca8-41b2-97e6-23deab9b3a91 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062055 Sep 15 13:08:56.469693 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 429/848] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:08:56 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:08:56.545581 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-9b9138b4-d1c4-432d-8359-bec1429a7487 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:56.546294 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-9b9138b4-d1c4-432d-8359-bec1429a7487 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:56.552559 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9b9138b4-d1c4-432d-8359-bec1429a7487 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:56.553050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9b9138b4-d1c4-432d-8359-bec1429a7487 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:56.553487 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9b9138b4-d1c4-432d-8359-bec1429a7487 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:56.554184 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9b9138b4-d1c4-432d-8359-bec1429a7487 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:56.554658 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9b9138b4-d1c4-432d-8359-bec1429a7487 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:56.555081 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9b9138b4-d1c4-432d-8359-bec1429a7487 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:56.571142 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:56.697335 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9b9138b4-d1c4-432d-8359-bec1429a7487 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:56.706414 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-9b9138b4-d1c4-432d-8359-bec1429a7487 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.165966 Sep 15 13:08:56.707009 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 420/849] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:56 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:57.477403 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-00317ab8-9418-48fd-984b-80e3d3a4b280 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:57.479499 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-00317ab8-9418-48fd-984b-80e3d3a4b280 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:57.486178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-00317ab8-9418-48fd-984b-80e3d3a4b280 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:57.486650 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-00317ab8-9418-48fd-984b-80e3d3a4b280 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:57.487076 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-00317ab8-9418-48fd-984b-80e3d3a4b280 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:57.487753 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-00317ab8-9418-48fd-984b-80e3d3a4b280 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:57.488196 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-00317ab8-9418-48fd-984b-80e3d3a4b280 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:57.488643 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-00317ab8-9418-48fd-984b-80e3d3a4b280 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:57.518580 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-00317ab8-9418-48fd-984b-80e3d3a4b280 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045111 Sep 15 13:08:57.519152 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 430/850] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:08:57 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:08:57.729909 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2a06c6dd-01a3-4dee-a7b2-9a6d3ed0b987 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:57.730454 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2a06c6dd-01a3-4dee-a7b2-9a6d3ed0b987 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:57.737319 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2a06c6dd-01a3-4dee-a7b2-9a6d3ed0b987 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:57.737802 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2a06c6dd-01a3-4dee-a7b2-9a6d3ed0b987 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:57.738237 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2a06c6dd-01a3-4dee-a7b2-9a6d3ed0b987 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:57.738927 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2a06c6dd-01a3-4dee-a7b2-9a6d3ed0b987 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:57.739378 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2a06c6dd-01a3-4dee-a7b2-9a6d3ed0b987 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:57.739799 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2a06c6dd-01a3-4dee-a7b2-9a6d3ed0b987 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:57.871615 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2a06c6dd-01a3-4dee-a7b2-9a6d3ed0b987 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:57.880204 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2a06c6dd-01a3-4dee-a7b2-9a6d3ed0b987 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1358 microversion: 2.1 time: 0.154160 Sep 15 13:08:57.880803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 421/851] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:57 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:58.532041 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-28efa578-34dd-4bbe-b7fc-3ffbdf03435a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:58.534361 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-28efa578-34dd-4bbe-b7fc-3ffbdf03435a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:58.540726 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28efa578-34dd-4bbe-b7fc-3ffbdf03435a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:58.541208 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28efa578-34dd-4bbe-b7fc-3ffbdf03435a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:58.541642 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28efa578-34dd-4bbe-b7fc-3ffbdf03435a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:58.542335 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28efa578-34dd-4bbe-b7fc-3ffbdf03435a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:58.542812 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28efa578-34dd-4bbe-b7fc-3ffbdf03435a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:58.543230 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-28efa578-34dd-4bbe-b7fc-3ffbdf03435a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:58.576181 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-28efa578-34dd-4bbe-b7fc-3ffbdf03435a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048311 Sep 15 13:08:58.581857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 431/852] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:08:58 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:08:58.902922 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f11a63a3-adc3-4cee-8aee-f142d33e59cd tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:58.905298 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f11a63a3-adc3-4cee-8aee-f142d33e59cd tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:58.911806 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f11a63a3-adc3-4cee-8aee-f142d33e59cd tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:58.912305 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f11a63a3-adc3-4cee-8aee-f142d33e59cd tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:58.912754 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f11a63a3-adc3-4cee-8aee-f142d33e59cd tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:58.913429 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f11a63a3-adc3-4cee-8aee-f142d33e59cd tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:58.913876 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f11a63a3-adc3-4cee-8aee-f142d33e59cd tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:58.914285 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f11a63a3-adc3-4cee-8aee-f142d33e59cd tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:59.052516 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f11a63a3-adc3-4cee-8aee-f142d33e59cd tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:59.060958 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f11a63a3-adc3-4cee-8aee-f142d33e59cd tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1548 microversion: 2.1 time: 0.161680 Sep 15 13:08:59.061534 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 422/853] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:58 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:59.083590 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ea597f64-31f6-48c4-a29a-2adc18f70171 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:59.084214 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ea597f64-31f6-48c4-a29a-2adc18f70171 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:59.091274 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ea597f64-31f6-48c4-a29a-2adc18f70171 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:59.091766 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ea597f64-31f6-48c4-a29a-2adc18f70171 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:59.092435 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ea597f64-31f6-48c4-a29a-2adc18f70171 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:59.093139 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ea597f64-31f6-48c4-a29a-2adc18f70171 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:59.093755 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ea597f64-31f6-48c4-a29a-2adc18f70171 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:59.094204 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ea597f64-31f6-48c4-a29a-2adc18f70171 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:59.230363 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ea597f64-31f6-48c4-a29a-2adc18f70171 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:59.238812 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ea597f64-31f6-48c4-a29a-2adc18f70171 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1548 microversion: 2.1 time: 0.159052 Sep 15 13:08:59.239823 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 432/854] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:59 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:59.260740 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-9fb4922a-087f-4dc2-aa37-70664077dc9a tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:59.266953 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9fb4922a-087f-4dc2-aa37-70664077dc9a tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:59.267741 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-9fb4922a-087f-4dc2-aa37-70664077dc9a tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Searching by: {'deleted': False, 'project_id': '8b815e753bbe4a54942550a564653fd8'} {{(pid=120634) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 15 13:08:59.274526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9fb4922a-087f-4dc2-aa37-70664077dc9a tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:59.275000 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9fb4922a-087f-4dc2-aa37-70664077dc9a tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:59.275435 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9fb4922a-087f-4dc2-aa37-70664077dc9a tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:59.276149 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9fb4922a-087f-4dc2-aa37-70664077dc9a tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:59.276627 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9fb4922a-087f-4dc2-aa37-70664077dc9a tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:59.277047 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9fb4922a-087f-4dc2-aa37-70664077dc9a tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:59.369466 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.multi_cell_list [None req-9fb4922a-087f-4dc2-aa37-70664077dc9a tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120634) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 15 13:08:59.468394 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-9fb4922a-087f-4dc2-aa37-70664077dc9a tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211386 Sep 15 13:08:59.469172 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 423/855] 10.222.0.57 () {58 vars in 1125 bytes} [Thu Sep 15 13:08:59 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:08:59.480322 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-1bc0fd49-f6f6-4c06-9664-2a0afec98f24 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:59.480933 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-1bc0fd49-f6f6-4c06-9664-2a0afec98f24 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:59.487664 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1bc0fd49-f6f6-4c06-9664-2a0afec98f24 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:59.488143 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1bc0fd49-f6f6-4c06-9664-2a0afec98f24 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:59.488605 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1bc0fd49-f6f6-4c06-9664-2a0afec98f24 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:59.489295 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1bc0fd49-f6f6-4c06-9664-2a0afec98f24 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:59.490298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1bc0fd49-f6f6-4c06-9664-2a0afec98f24 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:59.490298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-1bc0fd49-f6f6-4c06-9664-2a0afec98f24 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:59.588647 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0ad5ec39-312b-4c90-8162-314d19cfcaa1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:59.590912 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0ad5ec39-312b-4c90-8162-314d19cfcaa1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:59.597411 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0ad5ec39-312b-4c90-8162-314d19cfcaa1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:59.598236 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0ad5ec39-312b-4c90-8162-314d19cfcaa1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:59.598670 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0ad5ec39-312b-4c90-8162-314d19cfcaa1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:59.599712 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0ad5ec39-312b-4c90-8162-314d19cfcaa1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:59.600112 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0ad5ec39-312b-4c90-8162-314d19cfcaa1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:59.600637 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0ad5ec39-312b-4c90-8162-314d19cfcaa1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:59.633199 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0ad5ec39-312b-4c90-8162-314d19cfcaa1 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048525 Sep 15 13:08:59.633762 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 424/856] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:08:59 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 13:08:59.666710 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-1bc0fd49-f6f6-4c06-9664-2a0afec98f24 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:08:59.679812 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-1bc0fd49-f6f6-4c06-9664-2a0afec98f24 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1548 microversion: 2.1 time: 0.203165 Sep 15 13:08:59.688350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 433/857] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:59 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1548 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:08:59.698286 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1ade737e-602d-4f55-8951-406947cfaca4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:59.699154 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1ade737e-602d-4f55-8951-406947cfaca4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:59.705570 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1ade737e-602d-4f55-8951-406947cfaca4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:59.706538 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1ade737e-602d-4f55-8951-406947cfaca4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:59.706538 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1ade737e-602d-4f55-8951-406947cfaca4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:59.707184 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1ade737e-602d-4f55-8951-406947cfaca4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:59.707761 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1ade737e-602d-4f55-8951-406947cfaca4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:59.708133 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1ade737e-602d-4f55-8951-406947cfaca4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:59.734273 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1ade737e-602d-4f55-8951-406947cfaca4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Going to try to terminate instance {{(pid=120634) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:08:59.823709 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1ade737e-602d-4f55-8951-406947cfaca4 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 204 len: 0 microversion: 2.1 time: 0.128914 Sep 15 13:08:59.825012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 425/858] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:08:59 2022] DELETE /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:08:59.833699 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2da8bb6e-8da1-4305-81e1-f5d229a73617 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:08:59.834318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2da8bb6e-8da1-4305-81e1-f5d229a73617 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:08:59.840707 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2da8bb6e-8da1-4305-81e1-f5d229a73617 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:59.841722 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2da8bb6e-8da1-4305-81e1-f5d229a73617 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:59.841889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2da8bb6e-8da1-4305-81e1-f5d229a73617 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:59.842571 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2da8bb6e-8da1-4305-81e1-f5d229a73617 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:08:59.842968 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2da8bb6e-8da1-4305-81e1-f5d229a73617 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:08:59.843586 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2da8bb6e-8da1-4305-81e1-f5d229a73617 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:08:59.997668 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2da8bb6e-8da1-4305-81e1-f5d229a73617 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:00.006978 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2da8bb6e-8da1-4305-81e1-f5d229a73617 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1681 microversion: 2.1 time: 0.176969 Sep 15 13:09:00.008678 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 434/859] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:08:59 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:01.033981 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-bbab3b7d-e29b-4e3b-aae5-99dc2fa88f1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:01.034682 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-bbab3b7d-e29b-4e3b-aae5-99dc2fa88f1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:01.041063 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bbab3b7d-e29b-4e3b-aae5-99dc2fa88f1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:01.041547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bbab3b7d-e29b-4e3b-aae5-99dc2fa88f1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:01.041979 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bbab3b7d-e29b-4e3b-aae5-99dc2fa88f1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:01.042661 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bbab3b7d-e29b-4e3b-aae5-99dc2fa88f1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:01.043108 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bbab3b7d-e29b-4e3b-aae5-99dc2fa88f1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:01.043525 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bbab3b7d-e29b-4e3b-aae5-99dc2fa88f1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:01.189867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-bbab3b7d-e29b-4e3b-aae5-99dc2fa88f1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:01.197850 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-bbab3b7d-e29b-4e3b-aae5-99dc2fa88f1d tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1681 microversion: 2.1 time: 0.168129 Sep 15 13:09:01.198701 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 426/860] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:01 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:09:01.318483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bedf5443-5964-4d2c-b927-a8c8eac286d7 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d3d0b55-c294-4866-b5f1-b1d6a650bd22"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:01.320906 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-bedf5443-5964-4d2c-b927-a8c8eac286d7 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:01.327900 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bedf5443-5964-4d2c-b927-a8c8eac286d7 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:01.328423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bedf5443-5964-4d2c-b927-a8c8eac286d7 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:01.328860 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bedf5443-5964-4d2c-b927-a8c8eac286d7 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:01.329550 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bedf5443-5964-4d2c-b927-a8c8eac286d7 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:01.330001 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bedf5443-5964-4d2c-b927-a8c8eac286d7 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:01.330424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bedf5443-5964-4d2c-b927-a8c8eac286d7 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:01.756130 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-bedf5443-5964-4d2c-b927-a8c8eac286d7 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "POST /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.441482 Sep 15 13:09:01.761951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 435/861] 10.222.0.57 () {60 vars in 1323 bytes} [Thu Sep 15 13:09:01 2022] POST /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments => generated 194 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:01.853729 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-80117411", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "networks": [{"uuid": "f23a539b-43b1-4641-ae2c-1eaa74646362"}]}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:01.913454 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.network.neutron [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] validate_networks() for [('f23a539b-43b1-4641-ae2c-1eaa74646362', None, None, None, None, None)] {{(pid=120634) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:09:02.222046 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0ca17f32-7c59-4dc6-be15-7423ec11c76f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:02.222864 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0ca17f32-7c59-4dc6-be15-7423ec11c76f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:02.230349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ca17f32-7c59-4dc6-be15-7423ec11c76f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:02.230937 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ca17f32-7c59-4dc6-be15-7423ec11c76f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:02.232029 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ca17f32-7c59-4dc6-be15-7423ec11c76f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:02.232942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ca17f32-7c59-4dc6-be15-7423ec11c76f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:02.233406 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ca17f32-7c59-4dc6-be15-7423ec11c76f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:02.233834 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0ca17f32-7c59-4dc6-be15-7423ec11c76f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:02.374412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0ca17f32-7c59-4dc6-be15-7423ec11c76f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:02.382572 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0ca17f32-7c59-4dc6-be15-7423ec11c76f tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1681 microversion: 2.1 time: 0.165183 Sep 15 13:09:02.383149 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 436/862] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:02 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:09:02.581120 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Flavor limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:09:02.581653 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Image limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:09:02.582066 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Flavor pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:09:02.582457 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Image pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:09:02.582863 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:09:02.592006 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:02.592524 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:02.592955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:02.593670 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:02.594117 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:02.594533 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:02.611445 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Getting quotas for project 9472f5867b964202af54362d390c7509. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:09:02.615420 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Getting quotas for user 0fa77b2d0ace4ab3af23ec0a10e23ea1 and project 9472f5867b964202af54362d390c7509. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:09:02.626500 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Going to run 1 instances... {{(pid=120634) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:09:02.628811 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120634) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:09:02.677712 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ed01d8a9-1f1d-4177-bc52-930c4b969c72 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827756 Sep 15 13:09:02.678359 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 427/863] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:09:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 13:09:02.689329 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-18acf177-a66a-44a9-9a26-55a107b50b07 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:02.689961 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-18acf177-a66a-44a9-9a26-55a107b50b07 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:02.749825 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-18acf177-a66a-44a9-9a26-55a107b50b07 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:02.759574 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-18acf177-a66a-44a9-9a26-55a107b50b07 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 200 len: 1212 microversion: 2.1 time: 0.073736 Sep 15 13:09:02.777939 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 437/864] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:02 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:03.057911 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-939086b9-ce76-4c54-b632-ad2c6a8b4b98 req-3e5c7af5-4f1b-4921-865b-9bcd58836ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcaa24ea-1063-4b3c-b8d8-21d146c1ee89", "name": "network-vif-deleted", "tag": "6575d720-dfc5-42ca-a7be-43151adbebde"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:03.085760 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-939086b9-ce76-4c54-b632-ad2c6a8b4b98 req-3e5c7af5-4f1b-4921-865b-9bcd58836ac6 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:03.086512 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-939086b9-ce76-4c54-b632-ad2c6a8b4b98 req-3e5c7af5-4f1b-4921-865b-9bcd58836ac6 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:03.087134 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-939086b9-ce76-4c54-b632-ad2c6a8b4b98 req-3e5c7af5-4f1b-4921-865b-9bcd58836ac6 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:03.129793 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-939086b9-ce76-4c54-b632-ad2c6a8b4b98 req-3e5c7af5-4f1b-4921-865b-9bcd58836ac6 service nova] Creating event network-vif-deleted:6575d720-dfc5-42ca-a7be-43151adbebde for instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 on hv-cinder-83608 Sep 15 13:09:03.135171 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-939086b9-ce76-4c54-b632-ad2c6a8b4b98 req-3e5c7af5-4f1b-4921-865b-9bcd58836ac6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081057 Sep 15 13:09:03.135949 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 428/865] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:09:03.407570 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d8149952-6cfd-4012-91a1-95f625d738ca tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:03.408193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d8149952-6cfd-4012-91a1-95f625d738ca tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:03.415506 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8149952-6cfd-4012-91a1-95f625d738ca tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:03.416002 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8149952-6cfd-4012-91a1-95f625d738ca tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:03.416471 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8149952-6cfd-4012-91a1-95f625d738ca tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:03.417170 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8149952-6cfd-4012-91a1-95f625d738ca tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:03.417627 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8149952-6cfd-4012-91a1-95f625d738ca tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:03.418053 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8149952-6cfd-4012-91a1-95f625d738ca tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:03.448853 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8149952-6cfd-4012-91a1-95f625d738ca tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:03.449345 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8149952-6cfd-4012-91a1-95f625d738ca tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:03.449782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d8149952-6cfd-4012-91a1-95f625d738ca tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:03.450257 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-d8149952-6cfd-4012-91a1-95f625d738ca tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lazy-loading 'fault' on Instance uuid fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:09:03.490685 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d8149952-6cfd-4012-91a1-95f625d738ca tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd22d2df9ced4bb0961596385854422d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4c4dc894bd429b8f46ae444eb5ff7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:03.499047 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d8149952-6cfd-4012-91a1-95f625d738ca tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 200 len: 1331 microversion: 2.1 time: 0.096714 Sep 15 13:09:03.499624 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 438/866] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:03 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:03.786024 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e2e5af3e-c05f-4d66-ac00-fc90bb7de76e tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:03.786698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-e2e5af3e-c05f-4d66-ac00-fc90bb7de76e tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:03.793346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e2e5af3e-c05f-4d66-ac00-fc90bb7de76e tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:03.793995 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e2e5af3e-c05f-4d66-ac00-fc90bb7de76e tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:03.794530 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e2e5af3e-c05f-4d66-ac00-fc90bb7de76e tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:03.795394 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e2e5af3e-c05f-4d66-ac00-fc90bb7de76e tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:03.795947 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e2e5af3e-c05f-4d66-ac00-fc90bb7de76e tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:03.796698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e2e5af3e-c05f-4d66-ac00-fc90bb7de76e tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:03.879828 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e2e5af3e-c05f-4d66-ac00-fc90bb7de76e tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:03.891228 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e2e5af3e-c05f-4d66-ac00-fc90bb7de76e tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 200 len: 1264 microversion: 2.1 time: 0.109352 Sep 15 13:09:03.896842 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 429/867] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:03 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 1264 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:04.522119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0308a779-080c-4d50-aa59-f3188088b95a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:04.522863 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0308a779-080c-4d50-aa59-f3188088b95a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:04.530291 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0308a779-080c-4d50-aa59-f3188088b95a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:04.530863 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0308a779-080c-4d50-aa59-f3188088b95a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:04.531395 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0308a779-080c-4d50-aa59-f3188088b95a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:04.532197 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0308a779-080c-4d50-aa59-f3188088b95a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:04.532685 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0308a779-080c-4d50-aa59-f3188088b95a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:04.533122 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0308a779-080c-4d50-aa59-f3188088b95a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:04.547642 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-0308a779-080c-4d50-aa59-f3188088b95a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] HTTP exception thrown: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0308a779-080c-4d50-aa59-f3188088b95a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Request method failure captured: Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 HTTP/1.1 Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyF7i7azu69ujLWg4VmTaNmO_zlpZPMUNTZrbMEnkSIYxAt8-6t89_4emnOqEbXOd0vYTcUpuPUNe1odpy6Z_A42YWyOg_xfXoVm1614XjjnNtx-GDPzKOh0QDXFBzLzkRmidRDvMrs8mjeXHDo1r_RSCgjMCh8MlbrqEaex6H5lClc Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:09:04.549315 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:09:04.550975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e4c4dc894bd429b8f46ae444eb5ff7d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}] Sep 15 13:09:04.550975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:04.550975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:04.550975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:04.550975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:04.550975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:09:04.550975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:09:04.550975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: cd22d2df9ced4bb0961596385854422d Sep 15 13:09:04.550975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:04.550975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:09:04.550975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:04.550975 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': 'fcaa24ea-1063-4b3c-b8d8-21d146c1ee89'} Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:04.555193 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:04.556776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:04.558140 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0308a779-080c-4d50-aa59-f3188088b95a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Returning 404 to user: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:04.558140 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0308a779-080c-4d50-aa59-f3188088b95a tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 404 len: 111 microversion: 2.1 time: 0.032969 Sep 15 13:09:04.558140 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 439/868] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:04 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:09:04.559582 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-9188df0c-afea-4915-95a4-681c7b0059b0 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '.version_select at 0x7f62c8e18ca0>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:04.579037 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-9188df0c-afea-4915-95a4-681c7b0059b0 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1598014885" status: 202 len: 0 microversion: 2.1 time: 0.023252 Sep 15 13:09:04.579617 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 430/869] 10.222.0.57 () {58 vars in 1221 bytes} [Thu Sep 15 13:09:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1598014885 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:09:04.915010 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a73bdf5c-11cd-424a-a213-ec99439088ba tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:04.915623 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a73bdf5c-11cd-424a-a213-ec99439088ba tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:04.925867 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a73bdf5c-11cd-424a-a213-ec99439088ba tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:04.925867 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a73bdf5c-11cd-424a-a213-ec99439088ba tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:04.925867 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a73bdf5c-11cd-424a-a213-ec99439088ba tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:04.925867 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a73bdf5c-11cd-424a-a213-ec99439088ba tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:04.926538 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a73bdf5c-11cd-424a-a213-ec99439088ba tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:04.926538 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a73bdf5c-11cd-424a-a213-ec99439088ba tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:04.993384 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a73bdf5c-11cd-424a-a213-ec99439088ba tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:05.002955 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a73bdf5c-11cd-424a-a213-ec99439088ba tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 200 len: 1270 microversion: 2.1 time: 0.091922 Sep 15 13:09:05.004296 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 440/870] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:04 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:06.034706 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-9ae41c2f-0694-49b2-b5ce-f571398c1a52 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:06.035896 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-9ae41c2f-0694-49b2-b5ce-f571398c1a52 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:06.044678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9ae41c2f-0694-49b2-b5ce-f571398c1a52 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:06.045403 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9ae41c2f-0694-49b2-b5ce-f571398c1a52 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:06.045845 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9ae41c2f-0694-49b2-b5ce-f571398c1a52 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:06.046724 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9ae41c2f-0694-49b2-b5ce-f571398c1a52 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:06.047483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9ae41c2f-0694-49b2-b5ce-f571398c1a52 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:06.048095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9ae41c2f-0694-49b2-b5ce-f571398c1a52 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:06.165161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-a7cc0507-fce7-4025-b9d8-a2cbbe3b5d3b req-7cd13218-b6a8-476d-b9d5-3c8e6a769bea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfe4588a-9924-44b1-ab03-c8635cea4160", "tag": "009a471b-9402-4e82-9037-2675dee6dc22"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:06.175786 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-a7cc0507-fce7-4025-b9d8-a2cbbe3b5d3b req-7cd13218-b6a8-476d-b9d5-3c8e6a769bea service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:06.176311 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-a7cc0507-fce7-4025-b9d8-a2cbbe3b5d3b req-7cd13218-b6a8-476d-b9d5-3c8e6a769bea service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:06.176726 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-a7cc0507-fce7-4025-b9d8-a2cbbe3b5d3b req-7cd13218-b6a8-476d-b9d5-3c8e6a769bea service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:06.187914 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-a7cc0507-fce7-4025-b9d8-a2cbbe3b5d3b req-7cd13218-b6a8-476d-b9d5-3c8e6a769bea service nova] Creating event network-changed:009a471b-9402-4e82-9037-2675dee6dc22 for instance bfe4588a-9924-44b1-ab03-c8635cea4160 on hv-cinder-83608 Sep 15 13:09:06.192604 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-a7cc0507-fce7-4025-b9d8-a2cbbe3b5d3b req-7cd13218-b6a8-476d-b9d5-3c8e6a769bea service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031177 Sep 15 13:09:06.193204 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 441/871] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:09:06.284051 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9ae41c2f-0694-49b2-b5ce-f571398c1a52 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:06.291792 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-9ae41c2f-0694-49b2-b5ce-f571398c1a52 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 200 len: 1312 microversion: 2.1 time: 0.262515 Sep 15 13:09:06.292306 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 431/872] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:06 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:06.670874 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-61963f3b-e63e-4dae-90c2-0bb8b6df5d8c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:06.671460 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-61963f3b-e63e-4dae-90c2-0bb8b6df5d8c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:06.677724 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61963f3b-e63e-4dae-90c2-0bb8b6df5d8c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:06.678202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61963f3b-e63e-4dae-90c2-0bb8b6df5d8c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:06.678632 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61963f3b-e63e-4dae-90c2-0bb8b6df5d8c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:06.679324 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61963f3b-e63e-4dae-90c2-0bb8b6df5d8c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:06.679771 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61963f3b-e63e-4dae-90c2-0bb8b6df5d8c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:06.680182 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61963f3b-e63e-4dae-90c2-0bb8b6df5d8c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:06.694237 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-61963f3b-e63e-4dae-90c2-0bb8b6df5d8c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] HTTP exception thrown: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-61963f3b-e63e-4dae-90c2-0bb8b6df5d8c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Request method failure captured: Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: DELETE /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 HTTP/1.1 Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyF7i7azu69ujLWg4VmTaNmO_zlpZPMUNTZrbMEnkSIYxAt8-6t89_4emnOqEbXOd0vYTcUpuPUNe1odpy6Z_A42YWyOg_xfXoVm1614XjjnNtx-GDPzKOh0QDXFBzLzkRmidRDvMrs8mjeXHDo1r_RSCgjMCh8MlbrqEaex6H5lClc Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:09:06.695926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:09:06.697552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e4c4dc894bd429b8f46ae444eb5ff7d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}] Sep 15 13:09:06.697552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:06.697552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:06.697552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:06.697552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:06.697552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:09:06.697552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:09:06.697552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: cd22d2df9ced4bb0961596385854422d Sep 15 13:09:06.697552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:06.697552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:09:06.697552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:06.697552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': 'fcaa24ea-1063-4b3c-b8d8-21d146c1ee89'} Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:06.698376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:06.700407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:06.702023 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-61963f3b-e63e-4dae-90c2-0bb8b6df5d8c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Returning 404 to user: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:06.702023 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-61963f3b-e63e-4dae-90c2-0bb8b6df5d8c tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 404 len: 111 microversion: 2.1 time: 0.031395 Sep 15 13:09:06.702023 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 442/873] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:09:06 2022] DELETE /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:09:06.706552 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ef83dc2d-735c-4e0d-a772-f4237ea5e779 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:06.707162 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ef83dc2d-735c-4e0d-a772-f4237ea5e779 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: fcaa24ea-1063-4b3c-b8d8-21d146c1ee89] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:06.713316 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ef83dc2d-735c-4e0d-a772-f4237ea5e779 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:06.713800 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ef83dc2d-735c-4e0d-a772-f4237ea5e779 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:06.714226 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ef83dc2d-735c-4e0d-a772-f4237ea5e779 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:06.714925 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ef83dc2d-735c-4e0d-a772-f4237ea5e779 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:06.715368 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ef83dc2d-735c-4e0d-a772-f4237ea5e779 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:06.716537 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ef83dc2d-735c-4e0d-a772-f4237ea5e779 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:06.730928 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-ef83dc2d-735c-4e0d-a772-f4237ea5e779 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] HTTP exception thrown: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ef83dc2d-735c-4e0d-a772-f4237ea5e779 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Request method failure captured: Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 HTTP/1.1 Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyF7i7azu69ujLWg4VmTaNmO_zlpZPMUNTZrbMEnkSIYxAt8-6t89_4emnOqEbXOd0vYTcUpuPUNe1odpy6Z_A42YWyOg_xfXoVm1614XjjnNtx-GDPzKOh0QDXFBzLzkRmidRDvMrs8mjeXHDo1r_RSCgjMCh8MlbrqEaex6H5lClc Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:09:06.732788 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:09:06.734345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e4c4dc894bd429b8f46ae444eb5ff7d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}] Sep 15 13:09:06.734345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:06.734345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:06.734345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:06.734345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:06.734345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:09:06.734345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:09:06.734345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: cd22d2df9ced4bb0961596385854422d Sep 15 13:09:06.734345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:06.734345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:09:06.734345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:06.734345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': 'fcaa24ea-1063-4b3c-b8d8-21d146c1ee89'} Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:06.735194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. Sep 15 13:09:06.736633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:06.737979 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ef83dc2d-735c-4e0d-a772-f4237ea5e779 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Returning 404 to user: Instance fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:06.737979 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ef83dc2d-735c-4e0d-a772-f4237ea5e779 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89" status: 404 len: 111 microversion: 2.1 time: 0.031527 Sep 15 13:09:06.737979 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 432/874] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:06 2022] GET /compute/v2.1/servers/fcaa24ea-1063-4b3c-b8d8-21d146c1ee89 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:09:07.313997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-6a2dedb9-b3b2-47d8-b05e-1d07ee11783a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:07.314606 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-6a2dedb9-b3b2-47d8-b05e-1d07ee11783a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:07.321132 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6a2dedb9-b3b2-47d8-b05e-1d07ee11783a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:07.321605 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6a2dedb9-b3b2-47d8-b05e-1d07ee11783a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:07.322032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6a2dedb9-b3b2-47d8-b05e-1d07ee11783a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:07.322708 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6a2dedb9-b3b2-47d8-b05e-1d07ee11783a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:07.323152 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6a2dedb9-b3b2-47d8-b05e-1d07ee11783a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:07.323565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6a2dedb9-b3b2-47d8-b05e-1d07ee11783a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:07.455640 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-6a2dedb9-b3b2-47d8-b05e-1d07ee11783a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:07.463307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-6a2dedb9-b3b2-47d8-b05e-1d07ee11783a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 200 len: 1312 microversion: 2.1 time: 0.153539 Sep 15 13:09:07.463872 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 443/875] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:07 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:07.882423 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d8371e13-7f3b-4396-983d-667a6b594238 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:07.882903 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d8371e13-7f3b-4396-983d-667a6b594238 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:07.890175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d8371e13-7f3b-4396-983d-667a6b594238 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:07.890660 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d8371e13-7f3b-4396-983d-667a6b594238 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:07.891100 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d8371e13-7f3b-4396-983d-667a6b594238 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:07.891792 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d8371e13-7f3b-4396-983d-667a6b594238 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:07.892248 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d8371e13-7f3b-4396-983d-667a6b594238 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:07.892705 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d8371e13-7f3b-4396-983d-667a6b594238 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:07.906130 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-d8371e13-7f3b-4396-983d-667a6b594238 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] HTTP exception thrown: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d8371e13-7f3b-4396-983d-667a6b594238 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Request method failure captured: Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: DELETE /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a HTTP/1.1 Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyF7i7azu69ujLWg4VmTaNmO_zlpZPMUNTZrbMEnkSIYxAt8-6t89_4emnOqEbXOd0vYTcUpuPUNe1odpy6Z_A42YWyOg_xfXoVm1614XjjnNtx-GDPzKOh0QDXFBzLzkRmidRDvMrs8mjeXHDo1r_RSCgjMCh8MlbrqEaex6H5lClc Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:09:07.907684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:09:07.909280 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e4c4dc894bd429b8f46ae444eb5ff7d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}] Sep 15 13:09:07.909280 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:07.909280 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:07.909280 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:07.909280 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:07.909280 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:09:07.909280 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:09:07.909280 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: cd22d2df9ced4bb0961596385854422d Sep 15 13:09:07.909280 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:07.909280 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:09:07.909280 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:09:07.909280 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': 'd28efcba-b6d3-4758-b3ea-de3992bc888a'} Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:07.913019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:09:07.914483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.915952 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d8371e13-7f3b-4396-983d-667a6b594238 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Returning 404 to user: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:07.915952 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d8371e13-7f3b-4396-983d-667a6b594238 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 404 len: 111 microversion: 2.1 time: 0.030515 Sep 15 13:09:07.915952 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 433/876] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:09:07 2022] DELETE /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:09:07.917305 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-65918b44-00b7-4fc6-a7fb-5891ed2753d3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:07.917932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-65918b44-00b7-4fc6-a7fb-5891ed2753d3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: d28efcba-b6d3-4758-b3ea-de3992bc888a] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:07.923907 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-65918b44-00b7-4fc6-a7fb-5891ed2753d3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:07.924417 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-65918b44-00b7-4fc6-a7fb-5891ed2753d3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:07.924852 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-65918b44-00b7-4fc6-a7fb-5891ed2753d3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:07.925540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-65918b44-00b7-4fc6-a7fb-5891ed2753d3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:07.925993 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-65918b44-00b7-4fc6-a7fb-5891ed2753d3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:07.926417 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-65918b44-00b7-4fc6-a7fb-5891ed2753d3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:07.940219 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-65918b44-00b7-4fc6-a7fb-5891ed2753d3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] HTTP exception thrown: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-65918b44-00b7-4fc6-a7fb-5891ed2753d3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Request method failure captured: Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a HTTP/1.1 Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyF7i7azu69ujLWg4VmTaNmO_zlpZPMUNTZrbMEnkSIYxAt8-6t89_4emnOqEbXOd0vYTcUpuPUNe1odpy6Z_A42YWyOg_xfXoVm1614XjjnNtx-GDPzKOh0QDXFBzLzkRmidRDvMrs8mjeXHDo1r_RSCgjMCh8MlbrqEaex6H5lClc Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:09:07.941873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:09:07.943440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e4c4dc894bd429b8f46ae444eb5ff7d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}] Sep 15 13:09:07.943440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:07.943440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:07.943440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:07.943440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:07.943440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:09:07.943440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:09:07.943440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: cd22d2df9ced4bb0961596385854422d Sep 15 13:09:07.943440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:07.943440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:09:07.943440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:09:07.943440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': 'd28efcba-b6d3-4758-b3ea-de3992bc888a'} Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:07.944262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. Sep 15 13:09:07.945540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.946723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-65918b44-00b7-4fc6-a7fb-5891ed2753d3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Returning 404 to user: Instance d28efcba-b6d3-4758-b3ea-de3992bc888a could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:07.946723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-65918b44-00b7-4fc6-a7fb-5891ed2753d3 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a" status: 404 len: 111 microversion: 2.1 time: 0.029702 Sep 15 13:09:07.946723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 444/877] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:07 2022] GET /compute/v2.1/servers/d28efcba-b6d3-4758-b3ea-de3992bc888a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:09:07.952540 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3ac48234-5bda-446e-91b2-6505db977bbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:07.953068 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3ac48234-5bda-446e-91b2-6505db977bbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:07.958917 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3ac48234-5bda-446e-91b2-6505db977bbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:07.959392 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3ac48234-5bda-446e-91b2-6505db977bbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:07.959824 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3ac48234-5bda-446e-91b2-6505db977bbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:07.960542 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3ac48234-5bda-446e-91b2-6505db977bbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:07.960990 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3ac48234-5bda-446e-91b2-6505db977bbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:07.961445 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3ac48234-5bda-446e-91b2-6505db977bbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:07.974721 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-3ac48234-5bda-446e-91b2-6505db977bbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] HTTP exception thrown: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3ac48234-5bda-446e-91b2-6505db977bbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Request method failure captured: Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: DELETE /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 HTTP/1.1 Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyF7i7azu69ujLWg4VmTaNmO_zlpZPMUNTZrbMEnkSIYxAt8-6t89_4emnOqEbXOd0vYTcUpuPUNe1odpy6Z_A42YWyOg_xfXoVm1614XjjnNtx-GDPzKOh0QDXFBzLzkRmidRDvMrs8mjeXHDo1r_RSCgjMCh8MlbrqEaex6H5lClc Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:09:07.976235 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:09:07.977841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e4c4dc894bd429b8f46ae444eb5ff7d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}] Sep 15 13:09:07.977841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:07.977841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:07.977841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:07.977841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:07.977841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:09:07.977841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:09:07.977841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: cd22d2df9ced4bb0961596385854422d Sep 15 13:09:07.977841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:07.977841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:09:07.977841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:09:07.977841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': '5170c49a-0d2d-487f-abc1-2cc80ebb31b4'} Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:07.978955 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:09:07.980471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:07.982585 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3ac48234-5bda-446e-91b2-6505db977bbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Returning 404 to user: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:07.982585 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3ac48234-5bda-446e-91b2-6505db977bbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 404 len: 111 microversion: 2.1 time: 0.029585 Sep 15 13:09:07.982585 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 434/878] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:09:07 2022] DELETE /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:09:07.986171 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-68ce72ce-342f-4eb0-8453-e417b4fac730 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:07.986822 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-68ce72ce-342f-4eb0-8453-e417b4fac730 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 5170c49a-0d2d-487f-abc1-2cc80ebb31b4] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:07.992849 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-68ce72ce-342f-4eb0-8453-e417b4fac730 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:07.993329 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-68ce72ce-342f-4eb0-8453-e417b4fac730 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:07.993766 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-68ce72ce-342f-4eb0-8453-e417b4fac730 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:07.994460 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-68ce72ce-342f-4eb0-8453-e417b4fac730 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:07.994944 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-68ce72ce-342f-4eb0-8453-e417b4fac730 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:07.995367 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-68ce72ce-342f-4eb0-8453-e417b4fac730 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:08.009449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-68ce72ce-342f-4eb0-8453-e417b4fac730 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] HTTP exception thrown: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-68ce72ce-342f-4eb0-8453-e417b4fac730 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Request method failure captured: Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 HTTP/1.1 Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyF7i7azu69ujLWg4VmTaNmO_zlpZPMUNTZrbMEnkSIYxAt8-6t89_4emnOqEbXOd0vYTcUpuPUNe1odpy6Z_A42YWyOg_xfXoVm1614XjjnNtx-GDPzKOh0QDXFBzLzkRmidRDvMrs8mjeXHDo1r_RSCgjMCh8MlbrqEaex6H5lClc Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:09:08.010974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:09:08.012931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e4c4dc894bd429b8f46ae444eb5ff7d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}] Sep 15 13:09:08.012931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:08.012931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:08.012931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:08.012931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:08.012931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:09:08.012931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:09:08.012931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: cd22d2df9ced4bb0961596385854422d Sep 15 13:09:08.012931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:08.012931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:09:08.012931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:09:08.012931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '5170c49a-0d2d-487f-abc1-2cc80ebb31b4'} Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:08.014051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. Sep 15 13:09:08.015603 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:08.016981 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-68ce72ce-342f-4eb0-8453-e417b4fac730 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Returning 404 to user: Instance 5170c49a-0d2d-487f-abc1-2cc80ebb31b4 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:08.016981 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-68ce72ce-342f-4eb0-8453-e417b4fac730 tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4" status: 404 len: 111 microversion: 2.1 time: 0.029985 Sep 15 13:09:08.016981 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 445/879] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:07 2022] GET /compute/v2.1/servers/5170c49a-0d2d-487f-abc1-2cc80ebb31b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:09:08.362692 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-911864ae-69e0-4702-9543-19d855c4c677 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:08.364773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-911864ae-69e0-4702-9543-19d855c4c677 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:08.370619 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-911864ae-69e0-4702-9543-19d855c4c677 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:08.371115 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-911864ae-69e0-4702-9543-19d855c4c677 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:08.371528 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-911864ae-69e0-4702-9543-19d855c4c677 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:08.372811 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-911864ae-69e0-4702-9543-19d855c4c677 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:08.373250 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-911864ae-69e0-4702-9543-19d855c4c677 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:08.373667 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-911864ae-69e0-4702-9543-19d855c4c677 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:08.402246 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-911864ae-69e0-4702-9543-19d855c4c677 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043514 Sep 15 13:09:08.402789 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 435/880] 10.222.0.57 () {60 vars in 1343 bytes} [Thu Sep 15 13:09:08 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:08.469271 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2ef3fbf8-d33f-45c1-8e54-0451249d42d8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:08.469889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2ef3fbf8-d33f-45c1-8e54-0451249d42d8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:08.476294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2ef3fbf8-d33f-45c1-8e54-0451249d42d8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:08.476793 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2ef3fbf8-d33f-45c1-8e54-0451249d42d8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:08.477305 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2ef3fbf8-d33f-45c1-8e54-0451249d42d8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:08.477988 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2ef3fbf8-d33f-45c1-8e54-0451249d42d8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:08.478443 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2ef3fbf8-d33f-45c1-8e54-0451249d42d8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:08.478868 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2ef3fbf8-d33f-45c1-8e54-0451249d42d8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:08.482566 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:08.487082 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-86d4652d-a374-48b7-baf0-779e46c0cf92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:08.487696 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-86d4652d-a374-48b7-baf0-779e46c0cf92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:08.493586 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-86d4652d-a374-48b7-baf0-779e46c0cf92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:08.494069 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-86d4652d-a374-48b7-baf0-779e46c0cf92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:08.494498 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-86d4652d-a374-48b7-baf0-779e46c0cf92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:08.495185 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-86d4652d-a374-48b7-baf0-779e46c0cf92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:08.495633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-86d4652d-a374-48b7-baf0-779e46c0cf92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:08.496057 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-86d4652d-a374-48b7-baf0-779e46c0cf92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:08.508212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2ef3fbf8-d33f-45c1-8e54-0451249d42d8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Going to try to terminate instance {{(pid=120633) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:09:08.586617 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2ef3fbf8-d33f-45c1-8e54-0451249d42d8 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 204 len: 0 microversion: 2.20 time: 0.121004 Sep 15 13:09:08.587320 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 446/881] 10.222.0.57 () {60 vars in 1280 bytes} [Thu Sep 15 13:09:08 2022] DELETE /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 13:09:08.596670 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9d243fad-60da-49b5-9ae3-19af49810ddd tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:08.597361 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9d243fad-60da-49b5-9ae3-19af49810ddd tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:08.603470 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9d243fad-60da-49b5-9ae3-19af49810ddd tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:08.603932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9d243fad-60da-49b5-9ae3-19af49810ddd tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:08.604383 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9d243fad-60da-49b5-9ae3-19af49810ddd tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:08.605065 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9d243fad-60da-49b5-9ae3-19af49810ddd tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:08.605508 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9d243fad-60da-49b5-9ae3-19af49810ddd tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:08.605920 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9d243fad-60da-49b5-9ae3-19af49810ddd tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:08.633030 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-86d4652d-a374-48b7-baf0-779e46c0cf92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:08.640929 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-86d4652d-a374-48b7-baf0-779e46c0cf92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 200 len: 1312 microversion: 2.1 time: 0.158325 Sep 15 13:09:08.641497 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 436/882] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:08 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:09:08.736452 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9d243fad-60da-49b5-9ae3-19af49810ddd tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:08.744443 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9d243fad-60da-49b5-9ae3-19af49810ddd tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:08.745861 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9d243fad-60da-49b5-9ae3-19af49810ddd tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:08.747055 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9d243fad-60da-49b5-9ae3-19af49810ddd tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1725 microversion: 2.20 time: 0.154565 Sep 15 13:09:08.747712 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 447/883] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:09:08 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:09:09.154853 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fe7ee37a-5344-4587-9840-e45f593b4fbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:09.155345 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-fe7ee37a-5344-4587-9840-e45f593b4fbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:09.162254 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe7ee37a-5344-4587-9840-e45f593b4fbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:09.162736 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe7ee37a-5344-4587-9840-e45f593b4fbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:09.163175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe7ee37a-5344-4587-9840-e45f593b4fbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:09.163873 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe7ee37a-5344-4587-9840-e45f593b4fbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:09.164348 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe7ee37a-5344-4587-9840-e45f593b4fbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:09.164779 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fe7ee37a-5344-4587-9840-e45f593b4fbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:09.178535 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-fe7ee37a-5344-4587-9840-e45f593b4fbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] HTTP exception thrown: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fe7ee37a-5344-4587-9840-e45f593b4fbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Request method failure captured: Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: DELETE /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 HTTP/1.1 Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyF7i7azu69ujLWg4VmTaNmO_zlpZPMUNTZrbMEnkSIYxAt8-6t89_4emnOqEbXOd0vYTcUpuPUNe1odpy6Z_A42YWyOg_xfXoVm1614XjjnNtx-GDPzKOh0QDXFBzLzkRmidRDvMrs8mjeXHDo1r_RSCgjMCh8MlbrqEaex6H5lClc Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:09:09.180099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:09:09.181636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e4c4dc894bd429b8f46ae444eb5ff7d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}] Sep 15 13:09:09.181636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:09.181636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:09.181636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:09.181636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:09.181636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:09:09.181636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:09:09.181636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: cd22d2df9ced4bb0961596385854422d Sep 15 13:09:09.181636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:09.181636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:09:09.181636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:09:09.181636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': '7a48c801-810d-4702-a905-a6109e4786d8'} Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:09.182601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:09:09.184191 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:09.186195 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fe7ee37a-5344-4587-9840-e45f593b4fbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Returning 404 to user: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:09.186195 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-fe7ee37a-5344-4587-9840-e45f593b4fbe tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 404 len: 111 microversion: 2.1 time: 0.031191 Sep 15 13:09:09.186195 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 437/884] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:09:09 2022] DELETE /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:09:09.189990 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3a13cc28-4ae7-4a34-9921-a2fdfaeb9def tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:09.190611 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3a13cc28-4ae7-4a34-9921-a2fdfaeb9def tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] [instance: 7a48c801-810d-4702-a905-a6109e4786d8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:09.197338 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3a13cc28-4ae7-4a34-9921-a2fdfaeb9def tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:09.197842 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3a13cc28-4ae7-4a34-9921-a2fdfaeb9def tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:09.198266 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3a13cc28-4ae7-4a34-9921-a2fdfaeb9def tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:09.199108 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3a13cc28-4ae7-4a34-9921-a2fdfaeb9def tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:09.200359 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3a13cc28-4ae7-4a34-9921-a2fdfaeb9def tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:09.201935 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3a13cc28-4ae7-4a34-9921-a2fdfaeb9def tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:09.217498 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-3a13cc28-4ae7-4a34-9921-a2fdfaeb9def tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] HTTP exception thrown: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3a13cc28-4ae7-4a34-9921-a2fdfaeb9def tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Request method failure captured: Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 HTTP/1.1 Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyF7i7azu69ujLWg4VmTaNmO_zlpZPMUNTZrbMEnkSIYxAt8-6t89_4emnOqEbXOd0vYTcUpuPUNe1odpy6Z_A42YWyOg_xfXoVm1614XjjnNtx-GDPzKOh0QDXFBzLzkRmidRDvMrs8mjeXHDo1r_RSCgjMCh8MlbrqEaex6H5lClc Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:09:09.219154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:09:09.220847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e4c4dc894bd429b8f46ae444eb5ff7d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e4c4dc894bd429b8f46ae444eb5ff7d"}]}] Sep 15 13:09:09.220847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:09.220847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 2e4c4dc894bd429b8f46ae444eb5ff7d Sep 15 13:09:09.220847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-656598905 Sep 15 13:09:09.220847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:09.220847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:09:09.220847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:09:09.220847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: cd22d2df9ced4bb0961596385854422d Sep 15 13:09:09.220847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeNegativeTest-656598905-project Sep 15 13:09:09.220847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:09:09.220847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:09:09.220847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '7a48c801-810d-4702-a905-a6109e4786d8'} Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:09.221844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. Sep 15 13:09:09.223451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:09.225012 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3a13cc28-4ae7-4a34-9921-a2fdfaeb9def tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] Returning 404 to user: Instance 7a48c801-810d-4702-a905-a6109e4786d8 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:09.225012 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3a13cc28-4ae7-4a34-9921-a2fdfaeb9def tempest-AttachVolumeNegativeTest-656598905 tempest-AttachVolumeNegativeTest-656598905-project] 10.222.0.57 "GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8" status: 404 len: 111 microversion: 2.1 time: 0.034396 Sep 15 13:09:09.225012 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 448/885] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:09 2022] GET /compute/v2.1/servers/7a48c801-810d-4702-a905-a6109e4786d8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:09:09.662986 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-bc67547c-68e3-4403-9852-72d04d49a063 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:09.663593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-bc67547c-68e3-4403-9852-72d04d49a063 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:09.670327 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bc67547c-68e3-4403-9852-72d04d49a063 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:09.670829 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bc67547c-68e3-4403-9852-72d04d49a063 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:09.671268 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bc67547c-68e3-4403-9852-72d04d49a063 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:09.671993 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bc67547c-68e3-4403-9852-72d04d49a063 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:09.672475 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bc67547c-68e3-4403-9852-72d04d49a063 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:09.672901 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bc67547c-68e3-4403-9852-72d04d49a063 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:09.772837 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b97c138b-dc26-448f-b16e-cb879d110b4b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:09.773464 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b97c138b-dc26-448f-b16e-cb879d110b4b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:09.781090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b97c138b-dc26-448f-b16e-cb879d110b4b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:09.781774 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b97c138b-dc26-448f-b16e-cb879d110b4b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:09.782210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b97c138b-dc26-448f-b16e-cb879d110b4b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:09.782904 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b97c138b-dc26-448f-b16e-cb879d110b4b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:09.783352 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b97c138b-dc26-448f-b16e-cb879d110b4b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:09.783772 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b97c138b-dc26-448f-b16e-cb879d110b4b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:09.898208 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-bc67547c-68e3-4403-9852-72d04d49a063 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:09.906691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-bc67547c-68e3-4403-9852-72d04d49a063 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 200 len: 1312 microversion: 2.1 time: 0.247613 Sep 15 13:09:09.907269 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 438/886] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:09 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 1312 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:09.911537 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b97c138b-dc26-448f-b16e-cb879d110b4b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:09.921301 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b97c138b-dc26-448f-b16e-cb879d110b4b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:09.922808 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b97c138b-dc26-448f-b16e-cb879d110b4b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:09.924040 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b97c138b-dc26-448f-b16e-cb879d110b4b tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1725 microversion: 2.20 time: 0.155449 Sep 15 13:09:09.924638 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 449/887] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:09:09 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:09:10.951652 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3ddc6757-9781-4fdd-a2a7-a1b99ca62f74 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:10.952804 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3ddc6757-9781-4fdd-a2a7-a1b99ca62f74 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:10.960497 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3ddc6757-9781-4fdd-a2a7-a1b99ca62f74 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:10.961915 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3ddc6757-9781-4fdd-a2a7-a1b99ca62f74 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:10.962662 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3ddc6757-9781-4fdd-a2a7-a1b99ca62f74 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:10.963585 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3ddc6757-9781-4fdd-a2a7-a1b99ca62f74 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:10.964105 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3ddc6757-9781-4fdd-a2a7-a1b99ca62f74 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:10.964784 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3ddc6757-9781-4fdd-a2a7-a1b99ca62f74 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:10.992566 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-115975d1-c4d8-447b-8881-bf449cd4a3d9 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:10.994485 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-115975d1-c4d8-447b-8881-bf449cd4a3d9 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:11.004405 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-115975d1-c4d8-447b-8881-bf449cd4a3d9 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:11.004991 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-115975d1-c4d8-447b-8881-bf449cd4a3d9 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:11.005635 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-115975d1-c4d8-447b-8881-bf449cd4a3d9 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:11.006535 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-115975d1-c4d8-447b-8881-bf449cd4a3d9 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:11.007175 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-115975d1-c4d8-447b-8881-bf449cd4a3d9 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:11.007840 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-115975d1-c4d8-447b-8881-bf449cd4a3d9 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:11.173317 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-115975d1-c4d8-447b-8881-bf449cd4a3d9 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:11.183624 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-115975d1-c4d8-447b-8881-bf449cd4a3d9 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 200 len: 1312 microversion: 2.1 time: 0.195462 Sep 15 13:09:11.186226 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 450/888] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:10 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:11.207939 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3ddc6757-9781-4fdd-a2a7-a1b99ca62f74 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:11.216861 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3ddc6757-9781-4fdd-a2a7-a1b99ca62f74 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:11.218481 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3ddc6757-9781-4fdd-a2a7-a1b99ca62f74 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:11.219857 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3ddc6757-9781-4fdd-a2a7-a1b99ca62f74 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1725 microversion: 2.20 time: 0.273146 Sep 15 13:09:11.220440 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 439/889] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:09:10 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:09:12.208621 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-17522bef-b5f1-4da4-8ba6-b06408701e69 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:12.209842 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-17522bef-b5f1-4da4-8ba6-b06408701e69 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:12.218516 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-17522bef-b5f1-4da4-8ba6-b06408701e69 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:12.219046 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-17522bef-b5f1-4da4-8ba6-b06408701e69 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:12.219436 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-17522bef-b5f1-4da4-8ba6-b06408701e69 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:12.220146 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-17522bef-b5f1-4da4-8ba6-b06408701e69 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:12.220624 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-17522bef-b5f1-4da4-8ba6-b06408701e69 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:12.221049 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-17522bef-b5f1-4da4-8ba6-b06408701e69 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:12.246291 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2d543619-343b-4ac8-b1bc-2a8d5eab56b9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:12.247571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2d543619-343b-4ac8-b1bc-2a8d5eab56b9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:12.254822 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2d543619-343b-4ac8-b1bc-2a8d5eab56b9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:12.255534 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2d543619-343b-4ac8-b1bc-2a8d5eab56b9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:12.256132 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2d543619-343b-4ac8-b1bc-2a8d5eab56b9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:12.257040 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2d543619-343b-4ac8-b1bc-2a8d5eab56b9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:12.257665 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2d543619-343b-4ac8-b1bc-2a8d5eab56b9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:12.258269 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2d543619-343b-4ac8-b1bc-2a8d5eab56b9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:12.283469 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:12.433207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-17522bef-b5f1-4da4-8ba6-b06408701e69 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:12.443660 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-17522bef-b5f1-4da4-8ba6-b06408701e69 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 200 len: 1312 microversion: 2.1 time: 0.238755 Sep 15 13:09:12.445536 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 451/890] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:12 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:12.451492 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-fe1f7d8e-81dd-4321-939d-9b4091f0acd5 req-61e5ecbf-7f58-488c-9758-14ca4f56e5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfe4588a-9924-44b1-ab03-c8635cea4160", "name": "network-vif-plugged", "status": "completed", "tag": "009a471b-9402-4e82-9037-2675dee6dc22"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:12.463272 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-fe1f7d8e-81dd-4321-939d-9b4091f0acd5 req-61e5ecbf-7f58-488c-9758-14ca4f56e5bf service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:12.463979 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-fe1f7d8e-81dd-4321-939d-9b4091f0acd5 req-61e5ecbf-7f58-488c-9758-14ca4f56e5bf service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:12.464210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-fe1f7d8e-81dd-4321-939d-9b4091f0acd5 req-61e5ecbf-7f58-488c-9758-14ca4f56e5bf service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:12.484263 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-fe1f7d8e-81dd-4321-939d-9b4091f0acd5 req-61e5ecbf-7f58-488c-9758-14ca4f56e5bf service nova] Creating event network-vif-plugged:009a471b-9402-4e82-9037-2675dee6dc22 for instance bfe4588a-9924-44b1-ab03-c8635cea4160 on hv-cinder-83608 Sep 15 13:09:12.491626 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-fe1f7d8e-81dd-4321-939d-9b4091f0acd5 req-61e5ecbf-7f58-488c-9758-14ca4f56e5bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044995 Sep 15 13:09:12.492435 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 452/891] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:12.602471 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=4 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:12.622431 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=6 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:12.708617 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2d543619-343b-4ac8-b1bc-2a8d5eab56b9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:12.723570 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2d543619-343b-4ac8-b1bc-2a8d5eab56b9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:12.734965 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cb0465b5-3e55-4b04-a261-5d0ea83add3d tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:12.737916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cb0465b5-3e55-4b04-a261-5d0ea83add3d tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:12.742560 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cb0465b5-3e55-4b04-a261-5d0ea83add3d tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:12.743087 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cb0465b5-3e55-4b04-a261-5d0ea83add3d tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:12.743486 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cb0465b5-3e55-4b04-a261-5d0ea83add3d tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:12.744393 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cb0465b5-3e55-4b04-a261-5d0ea83add3d tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:12.745041 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cb0465b5-3e55-4b04-a261-5d0ea83add3d tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:12.745470 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cb0465b5-3e55-4b04-a261-5d0ea83add3d tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:12.757684 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2d543619-343b-4ac8-b1bc-2a8d5eab56b9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:12.760763 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2d543619-343b-4ac8-b1bc-2a8d5eab56b9 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1725 microversion: 2.20 time: 0.518281 Sep 15 13:09:12.766450 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:12.782906 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 440/892] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:09:12 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1725 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 13:09:12.976367 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cb0465b5-3e55-4b04-a261-5d0ea83add3d tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:12.985878 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cb0465b5-3e55-4b04-a261-5d0ea83add3d tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1594 microversion: 2.1 time: 0.256196 Sep 15 13:09:12.986774 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 453/893] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:12 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1594 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:09:13.423881 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-08fec0d0-87f5-4239-a42e-0d39dd32804f req-feb613c6-9700-4b68-900f-c652763acdd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f141686-0b27-4fd1-9e23-6634ade717ae", "name": "network-vif-deleted", "tag": "2e211122-d0c5-4c5f-9b31-8e606a42abd5"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:13.433494 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:13.441114 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-08fec0d0-87f5-4239-a42e-0d39dd32804f req-feb613c6-9700-4b68-900f-c652763acdd0 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:13.441879 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-08fec0d0-87f5-4239-a42e-0d39dd32804f req-feb613c6-9700-4b68-900f-c652763acdd0 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:13.442472 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-08fec0d0-87f5-4239-a42e-0d39dd32804f req-feb613c6-9700-4b68-900f-c652763acdd0 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:13.455619 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-08fec0d0-87f5-4239-a42e-0d39dd32804f req-feb613c6-9700-4b68-900f-c652763acdd0 service nova] Creating event network-vif-deleted:2e211122-d0c5-4c5f-9b31-8e606a42abd5 for instance 8f141686-0b27-4fd1-9e23-6634ade717ae on hv-cinder-83608 Sep 15 13:09:13.461519 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-08fec0d0-87f5-4239-a42e-0d39dd32804f req-feb613c6-9700-4b68-900f-c652763acdd0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041239 Sep 15 13:09:13.462757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 441/894] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:13.473690 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b74a3110-4dc8-4953-877f-cba241599a50 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:13.474406 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b74a3110-4dc8-4953-877f-cba241599a50 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:13.482823 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b74a3110-4dc8-4953-877f-cba241599a50 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:13.483959 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b74a3110-4dc8-4953-877f-cba241599a50 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:13.484611 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b74a3110-4dc8-4953-877f-cba241599a50 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:13.485698 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b74a3110-4dc8-4953-877f-cba241599a50 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:13.486381 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b74a3110-4dc8-4953-877f-cba241599a50 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:13.486983 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b74a3110-4dc8-4953-877f-cba241599a50 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:13.802516 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ace056c4-b642-4118-a38d-4b604f1bbb24 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:13.803689 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ace056c4-b642-4118-a38d-4b604f1bbb24 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:13.808010 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b74a3110-4dc8-4953-877f-cba241599a50 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:13.817063 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ace056c4-b642-4118-a38d-4b604f1bbb24 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:13.817633 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b74a3110-4dc8-4953-877f-cba241599a50 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 200 len: 1312 microversion: 2.1 time: 0.351352 Sep 15 13:09:13.817772 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ace056c4-b642-4118-a38d-4b604f1bbb24 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:13.818219 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 454/895] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:13 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 1312 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:13.834019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ace056c4-b642-4118-a38d-4b604f1bbb24 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:13.834019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ace056c4-b642-4118-a38d-4b604f1bbb24 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:13.834019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ace056c4-b642-4118-a38d-4b604f1bbb24 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:13.834019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ace056c4-b642-4118-a38d-4b604f1bbb24 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:13.953695 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ace056c4-b642-4118-a38d-4b604f1bbb24 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:13.973747 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ace056c4-b642-4118-a38d-4b604f1bbb24 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:13.979915 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ace056c4-b642-4118-a38d-4b604f1bbb24 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:13.988256 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ace056c4-b642-4118-a38d-4b604f1bbb24 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1657 microversion: 2.20 time: 0.185482 Sep 15 13:09:14.000299 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 442/896] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:09:13 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1657 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:09:14.842937 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5e8190b7-7253-487f-94f3-71740e77d8a6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:14.843764 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-5e8190b7-7253-487f-94f3-71740e77d8a6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:14.851672 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5e8190b7-7253-487f-94f3-71740e77d8a6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:14.852878 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5e8190b7-7253-487f-94f3-71740e77d8a6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:14.856714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5e8190b7-7253-487f-94f3-71740e77d8a6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:14.859746 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5e8190b7-7253-487f-94f3-71740e77d8a6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:14.860259 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5e8190b7-7253-487f-94f3-71740e77d8a6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:14.860729 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5e8190b7-7253-487f-94f3-71740e77d8a6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:15.017180 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:15.019376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:15.026564 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:15.027302 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:15.028972 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:15.029895 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:15.030510 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:15.031100 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:15.068818 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-5e8190b7-7253-487f-94f3-71740e77d8a6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:15.069491 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:15.070090 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:15.070416 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:15.070922 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lazy-loading 'fault' on Instance uuid 8f141686-0b27-4fd1-9e23-6634ade717ae {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:09:15.081710 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-5e8190b7-7253-487f-94f3-71740e77d8a6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 200 len: 1497 microversion: 2.1 time: 0.243841 Sep 15 13:09:15.093099 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 455/897] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:14 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 1497 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:15.116254 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:15.126618 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:15.128057 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f0feb7134ee408b989b398a315850fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6180da28285943f7a7b0900185df6127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:15.129715 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c2810dc4-b377-4028-bfef-464b24d441a6 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 200 len: 1372 microversion: 2.20 time: 0.118429 Sep 15 13:09:15.130680 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 443/898] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:09:15 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 1372 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 13:09:15.603269 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-92d5847c-bda2-436d-b833-a3e1ef144398 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:15.603775 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-92d5847c-bda2-436d-b833-a3e1ef144398 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:15.610688 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-92d5847c-bda2-436d-b833-a3e1ef144398 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:15.611428 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-92d5847c-bda2-436d-b833-a3e1ef144398 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:15.612324 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-92d5847c-bda2-436d-b833-a3e1ef144398 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:15.613922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-92d5847c-bda2-436d-b833-a3e1ef144398 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:15.614753 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-92d5847c-bda2-436d-b833-a3e1ef144398 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:15.615486 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-92d5847c-bda2-436d-b833-a3e1ef144398 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:15.642101 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-92d5847c-bda2-436d-b833-a3e1ef144398 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Going to try to terminate instance {{(pid=120633) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:09:15.730310 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-92d5847c-bda2-436d-b833-a3e1ef144398 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 204 len: 0 microversion: 2.1 time: 0.130546 Sep 15 13:09:15.735078 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 456/899] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:09:15 2022] DELETE /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:09:15.743715 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e4cbe5d8-4201-4908-af91-e5a34efd018b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:15.744464 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-e4cbe5d8-4201-4908-af91-e5a34efd018b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:15.752382 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e4cbe5d8-4201-4908-af91-e5a34efd018b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:15.753063 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e4cbe5d8-4201-4908-af91-e5a34efd018b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:15.755205 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e4cbe5d8-4201-4908-af91-e5a34efd018b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:15.756808 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e4cbe5d8-4201-4908-af91-e5a34efd018b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:15.757340 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e4cbe5d8-4201-4908-af91-e5a34efd018b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:15.757832 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e4cbe5d8-4201-4908-af91-e5a34efd018b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:15.776294 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-32d88b76-73ed-43da-a2fe-dec204a0a586 req-a31c56bc-dc2d-4b47-b680-34792dba9429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6fe9060-6085-4ae1-90d1-dc0ed730c243", "tag": "8664056d-9981-4374-9627-df05e9500424"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:15.798284 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-32d88b76-73ed-43da-a2fe-dec204a0a586 req-a31c56bc-dc2d-4b47-b680-34792dba9429 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:15.798766 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-32d88b76-73ed-43da-a2fe-dec204a0a586 req-a31c56bc-dc2d-4b47-b680-34792dba9429 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:15.799198 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-32d88b76-73ed-43da-a2fe-dec204a0a586 req-a31c56bc-dc2d-4b47-b680-34792dba9429 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:15.831717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-32d88b76-73ed-43da-a2fe-dec204a0a586 req-a31c56bc-dc2d-4b47-b680-34792dba9429 service nova] Creating event network-changed:8664056d-9981-4374-9627-df05e9500424 for instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 on hv-cinder-83608 Sep 15 13:09:15.838069 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-32d88b76-73ed-43da-a2fe-dec204a0a586 req-a31c56bc-dc2d-4b47-b680-34792dba9429 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065980 Sep 15 13:09:15.839685 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 457/900] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:15.958170 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e4cbe5d8-4201-4908-af91-e5a34efd018b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:15.966731 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e4cbe5d8-4201-4908-af91-e5a34efd018b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 200 len: 1503 microversion: 2.1 time: 0.229934 Sep 15 13:09:15.967634 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 444/901] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:15 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:16.158817 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-15be20fc-6435-4cd1-b4f8-e4a15667d022 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:16.159512 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-15be20fc-6435-4cd1-b4f8-e4a15667d022 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:16.171629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-15be20fc-6435-4cd1-b4f8-e4a15667d022 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:16.172406 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-15be20fc-6435-4cd1-b4f8-e4a15667d022 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:16.173507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-15be20fc-6435-4cd1-b4f8-e4a15667d022 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:16.173961 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-15be20fc-6435-4cd1-b4f8-e4a15667d022 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:16.174430 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-15be20fc-6435-4cd1-b4f8-e4a15667d022 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:16.174858 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-15be20fc-6435-4cd1-b4f8-e4a15667d022 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:16.189619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-15be20fc-6435-4cd1-b4f8-e4a15667d022 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] HTTP exception thrown: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-15be20fc-6435-4cd1-b4f8-e4a15667d022 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Request method failure captured: Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae HTTP/1.1 Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyGGYRzHJ05hjHYgSTJM4m5vV4OGNuAzzTXy_b-nXNy4za0VZ8ff_XnOR0L6DEJjE1uvsP_b-yP7TJQWb3u16zemup6MPJKsdmr4ohzSITEb3JhwPOPdIbb5HINoAcXD1WmYgGLyGu3akKmPCYsqX6rCuqs4srW6XGS_xle_PrdIt3o Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 6180da28285943f7a7b0900185df6127 Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:09:16.191927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:09:16.193507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6180da28285943f7a7b0900185df6127", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6180da28285943f7a7b0900185df6127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6180da28285943f7a7b0900185df6127"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6180da28285943f7a7b0900185df6127"}]}] Sep 15 13:09:16.193507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:16.193507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 6180da28285943f7a7b0900185df6127 Sep 15 13:09:16.193507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:16.193507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeShelveTestJSON-2136858861-project Sep 15 13:09:16.193507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:09:16.193507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:09:16.193507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 2f0feb7134ee408b989b398a315850fe Sep 15 13:09:16.193507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2136858861-project Sep 15 13:09:16.193507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:09:16.193507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:16.193507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '8f141686-0b27-4fd1-9e23-6634ade717ae'} Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:16.194297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:16.195634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:16.198746 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-15be20fc-6435-4cd1-b4f8-e4a15667d022 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Returning 404 to user: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:16.200526 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-15be20fc-6435-4cd1-b4f8-e4a15667d022 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 404 len: 111 microversion: 2.20 time: 0.045751 Sep 15 13:09:16.209805 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-900911b4-9e3c-4778-8d4a-3a53a76a6a9c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '.version_select at 0x7f62c8d618b0>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:16.216251 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 458/902] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:09:16 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 13:09:16.232488 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-900911b4-9e3c-4778-8d4a-3a53a76a6a9c tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125845498" status: 204 len: 0 microversion: 2.20 time: 0.026213 Sep 15 13:09:16.236709 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 445/903] 10.222.0.57 () {60 vars in 1262 bytes} [Thu Sep 15 13:09:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125845498 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 13:09:16.991648 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9dd7b807-f628-449d-ac29-4a2aedc1be1c tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:16.992576 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9dd7b807-f628-449d-ac29-4a2aedc1be1c tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:17.005949 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9dd7b807-f628-449d-ac29-4a2aedc1be1c tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:17.005949 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9dd7b807-f628-449d-ac29-4a2aedc1be1c tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:17.006410 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9dd7b807-f628-449d-ac29-4a2aedc1be1c tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:17.008754 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9dd7b807-f628-449d-ac29-4a2aedc1be1c tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:17.009221 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9dd7b807-f628-449d-ac29-4a2aedc1be1c tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:17.011949 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9dd7b807-f628-449d-ac29-4a2aedc1be1c tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:17.198189 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-bb5c6abb-a791-4c3d-8ea9-b1072aeac55f tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-752529055"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:17.198731 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-bb5c6abb-a791-4c3d-8ea9-b1072aeac55f tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:17.206094 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bb5c6abb-a791-4c3d-8ea9-b1072aeac55f tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:17.206431 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bb5c6abb-a791-4c3d-8ea9-b1072aeac55f tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:17.206871 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bb5c6abb-a791-4c3d-8ea9-b1072aeac55f tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:17.207579 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bb5c6abb-a791-4c3d-8ea9-b1072aeac55f tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:17.208020 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9dd7b807-f628-449d-ac29-4a2aedc1be1c tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:17.208575 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bb5c6abb-a791-4c3d-8ea9-b1072aeac55f tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:17.208575 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bb5c6abb-a791-4c3d-8ea9-b1072aeac55f tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:17.218630 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9dd7b807-f628-449d-ac29-4a2aedc1be1c tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 200 len: 1503 microversion: 2.1 time: 0.230936 Sep 15 13:09:17.219312 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 459/904] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:16 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 1503 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:17.384862 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.network.security_group_api [None req-bb5c6abb-a791-4c3d-8ea9-b1072aeac55f tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Adding security group 0f1a6ec3-56b3-4108-a5c2-6f34c3a1808b to port 8664056d-9981-4374-9627-df05e9500424 Sep 15 13:09:18.188387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ff34c475-f3c1-4f90-bb7c-701df9b421a5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:18.188888 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ff34c475-f3c1-4f90-bb7c-701df9b421a5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:18.195538 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff34c475-f3c1-4f90-bb7c-701df9b421a5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:18.196104 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff34c475-f3c1-4f90-bb7c-701df9b421a5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:18.196717 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff34c475-f3c1-4f90-bb7c-701df9b421a5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:18.197452 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff34c475-f3c1-4f90-bb7c-701df9b421a5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:18.197947 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff34c475-f3c1-4f90-bb7c-701df9b421a5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:18.198409 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ff34c475-f3c1-4f90-bb7c-701df9b421a5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:18.214914 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-ff34c475-f3c1-4f90-bb7c-701df9b421a5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] HTTP exception thrown: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ff34c475-f3c1-4f90-bb7c-701df9b421a5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Request method failure captured: Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: DELETE /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae HTTP/1.1 Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyGGYRzHJ05hjHYgSTJM4m5vV4OGNuAzzTXy_b-nXNy4za0VZ8ff_XnOR0L6DEJjE1uvsP_b-yP7TJQWb3u16zemup6MPJKsdmr4ohzSITEb3JhwPOPdIbb5HINoAcXD1WmYgGLyGu3akKmPCYsqX6rCuqs4srW6XGS_xle_PrdIt3o Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 6180da28285943f7a7b0900185df6127 Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:09:18.217349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:09:18.219110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6180da28285943f7a7b0900185df6127", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6180da28285943f7a7b0900185df6127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6180da28285943f7a7b0900185df6127"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6180da28285943f7a7b0900185df6127"}]}] Sep 15 13:09:18.219110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:18.219110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 6180da28285943f7a7b0900185df6127 Sep 15 13:09:18.219110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:18.219110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeShelveTestJSON-2136858861-project Sep 15 13:09:18.219110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:09:18.219110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:09:18.219110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 2f0feb7134ee408b989b398a315850fe Sep 15 13:09:18.219110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2136858861-project Sep 15 13:09:18.219110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:09:18.219110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:18.219110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '8f141686-0b27-4fd1-9e23-6634ade717ae'} Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:18.220507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:18.222552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:18.228640 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ff34c475-f3c1-4f90-bb7c-701df9b421a5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Returning 404 to user: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:18.228640 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ff34c475-f3c1-4f90-bb7c-701df9b421a5 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 404 len: 111 microversion: 2.20 time: 0.034152 Sep 15 13:09:18.228640 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 460/905] 10.222.0.57 () {60 vars in 1280 bytes} [Thu Sep 15 13:09:18 2022] DELETE /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 15 13:09:18.228889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-bb5c6abb-a791-4c3d-8ea9-b1072aeac55f tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "POST /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/action" status: 202 len: 0 microversion: 2.1 time: 1.029437 Sep 15 13:09:18.228889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 446/906] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Sep 15 13:09:17 2022] POST /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/action => generated 0 bytes in 1032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 13:09:18.229156 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-159c3842-56d0-4e71-8a86-487b63757220 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:18.229156 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-159c3842-56d0-4e71-8a86-487b63757220 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 8f141686-0b27-4fd1-9e23-6634ade717ae] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:18.237039 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-159c3842-56d0-4e71-8a86-487b63757220 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:18.242029 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-159c3842-56d0-4e71-8a86-487b63757220 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:18.247493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-159c3842-56d0-4e71-8a86-487b63757220 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:18.248303 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-159c3842-56d0-4e71-8a86-487b63757220 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:18.248766 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-159c3842-56d0-4e71-8a86-487b63757220 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:18.250395 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-159c3842-56d0-4e71-8a86-487b63757220 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:18.277575 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-159c3842-56d0-4e71-8a86-487b63757220 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] HTTP exception thrown: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-159c3842-56d0-4e71-8a86-487b63757220 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Request method failure captured: Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae HTTP/1.1 Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyGGYRzHJ05hjHYgSTJM4m5vV4OGNuAzzTXy_b-nXNy4za0VZ8ff_XnOR0L6DEJjE1uvsP_b-yP7TJQWb3u16zemup6MPJKsdmr4ohzSITEb3JhwPOPdIbb5HINoAcXD1WmYgGLyGu3akKmPCYsqX6rCuqs4srW6XGS_xle_PrdIt3o Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 6180da28285943f7a7b0900185df6127 Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:09:18.279709 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:09:18.281449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6180da28285943f7a7b0900185df6127", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6180da28285943f7a7b0900185df6127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6180da28285943f7a7b0900185df6127"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6180da28285943f7a7b0900185df6127"}]}] Sep 15 13:09:18.281449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:18.281449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 6180da28285943f7a7b0900185df6127 Sep 15 13:09:18.281449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:18.281449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeShelveTestJSON-2136858861-project Sep 15 13:09:18.281449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:09:18.281449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:09:18.281449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 2f0feb7134ee408b989b398a315850fe Sep 15 13:09:18.281449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2136858861-project Sep 15 13:09:18.281449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:09:18.281449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:18.281449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '8f141686-0b27-4fd1-9e23-6634ade717ae'} Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:18.282350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. Sep 15 13:09:18.283810 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:18.286346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-159c3842-56d0-4e71-8a86-487b63757220 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Returning 404 to user: Instance 8f141686-0b27-4fd1-9e23-6634ade717ae could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:18.289724 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-159c3842-56d0-4e71-8a86-487b63757220 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae" status: 404 len: 111 microversion: 2.20 time: 0.065672 Sep 15 13:09:18.291058 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 461/907] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:09:18 2022] GET /compute/v2.1/servers/8f141686-0b27-4fd1-9e23-6634ade717ae => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 13:09:18.301462 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-42e1a138-7bdc-431a-a032-882c0a78d0e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:18.302623 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-42e1a138-7bdc-431a-a032-882c0a78d0e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:18.310830 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-42e1a138-7bdc-431a-a032-882c0a78d0e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:18.311628 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-42e1a138-7bdc-431a-a032-882c0a78d0e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:18.313104 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-42e1a138-7bdc-431a-a032-882c0a78d0e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:18.314054 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-42e1a138-7bdc-431a-a032-882c0a78d0e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:18.314671 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-42e1a138-7bdc-431a-a032-882c0a78d0e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:18.315255 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-42e1a138-7bdc-431a-a032-882c0a78d0e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:18.436156 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-41cf5817-6509-4aa1-8b98-7067d507d4c5 req-17803406-147e-4dba-9907-346779f9b52e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6fe9060-6085-4ae1-90d1-dc0ed730c243", "tag": "8664056d-9981-4374-9627-df05e9500424"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:18.447363 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-41cf5817-6509-4aa1-8b98-7067d507d4c5 req-17803406-147e-4dba-9907-346779f9b52e service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:18.448098 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-41cf5817-6509-4aa1-8b98-7067d507d4c5 req-17803406-147e-4dba-9907-346779f9b52e service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:18.448554 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-41cf5817-6509-4aa1-8b98-7067d507d4c5 req-17803406-147e-4dba-9907-346779f9b52e service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:18.464772 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-41cf5817-6509-4aa1-8b98-7067d507d4c5 req-17803406-147e-4dba-9907-346779f9b52e service nova] Creating event network-changed:8664056d-9981-4374-9627-df05e9500424 for instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 on hv-cinder-83608 Sep 15 13:09:18.480394 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-41cf5817-6509-4aa1-8b98-7067d507d4c5 req-17803406-147e-4dba-9907-346779f9b52e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249437 Sep 15 13:09:18.481619 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 447/908] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:18.486824 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-373c4d99-b623-41aa-b09d-8aa203a844f7 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:18.487525 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-373c4d99-b623-41aa-b09d-8aa203a844f7 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:18.493867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-373c4d99-b623-41aa-b09d-8aa203a844f7 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:18.494362 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-373c4d99-b623-41aa-b09d-8aa203a844f7 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:18.494800 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-373c4d99-b623-41aa-b09d-8aa203a844f7 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:18.495504 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-373c4d99-b623-41aa-b09d-8aa203a844f7 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:18.495962 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-373c4d99-b623-41aa-b09d-8aa203a844f7 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:18.496480 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-373c4d99-b623-41aa-b09d-8aa203a844f7 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:18.531310 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-42e1a138-7bdc-431a-a032-882c0a78d0e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:18.550911 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-42e1a138-7bdc-431a-a032-882c0a78d0e5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1759 microversion: 2.1 time: 0.254683 Sep 15 13:09:18.552218 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 462/909] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:18 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1759 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:18.590321 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-373c4d99-b623-41aa-b09d-8aa203a844f7 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:18.605607 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-373c4d99-b623-41aa-b09d-8aa203a844f7 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 200 len: 1461 microversion: 2.1 time: 0.122291 Sep 15 13:09:18.606348 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 448/910] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:18 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 1461 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:19.519032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a4682055-a7ab-4646-adb5-a5e9db7e2ad1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:19.519553 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a4682055-a7ab-4646-adb5-a5e9db7e2ad1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:19.525918 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a4682055-a7ab-4646-adb5-a5e9db7e2ad1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:19.526406 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a4682055-a7ab-4646-adb5-a5e9db7e2ad1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:19.526835 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a4682055-a7ab-4646-adb5-a5e9db7e2ad1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:19.527521 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a4682055-a7ab-4646-adb5-a5e9db7e2ad1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:19.528869 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a4682055-a7ab-4646-adb5-a5e9db7e2ad1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:19.529295 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a4682055-a7ab-4646-adb5-a5e9db7e2ad1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:19.634631 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-867c7b53-2380-4a3e-8cdb-72e4a3e998b6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:19.635646 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-867c7b53-2380-4a3e-8cdb-72e4a3e998b6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: bfe4588a-9924-44b1-ab03-c8635cea4160] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:19.643452 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-867c7b53-2380-4a3e-8cdb-72e4a3e998b6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:19.643937 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-867c7b53-2380-4a3e-8cdb-72e4a3e998b6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:19.644395 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-867c7b53-2380-4a3e-8cdb-72e4a3e998b6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:19.645100 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-867c7b53-2380-4a3e-8cdb-72e4a3e998b6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:19.645554 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-867c7b53-2380-4a3e-8cdb-72e4a3e998b6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:19.645965 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-867c7b53-2380-4a3e-8cdb-72e4a3e998b6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:19.661695 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-867c7b53-2380-4a3e-8cdb-72e4a3e998b6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] HTTP exception thrown: Instance bfe4588a-9924-44b1-ab03-c8635cea4160 could not be found. Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-867c7b53-2380-4a3e-8cdb-72e4a3e998b6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Request method failure captured: Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 HTTP/1.1 Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyPsRZPeq48tkkttUdD8f8ZMqTfxegmnPNxDpVWKdatTYktxiUjRYcw_CzI74G7coI2OaNnzdb7ex-cXLVaxpfWGdKHiv4zQKeeuCqXh9wRYryxwvS124BdmuVJG5qJHMaDqNisjzcesKCrKXZpcQ9kHJg-aoURrX8SgQhQRhuC5UDc Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 9472f5867b964202af54362d390c7509 Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-VolumesActionsTest-1505974574 Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:09:19.663346 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:09:19.665050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9472f5867b964202af54362d390c7509", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9472f5867b964202af54362d390c7509"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9472f5867b964202af54362d390c7509"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9472f5867b964202af54362d390c7509"}]}] Sep 15 13:09:19.665050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-VolumesActionsTest-1505974574 Sep 15 13:09:19.665050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 9472f5867b964202af54362d390c7509 Sep 15 13:09:19.665050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-VolumesActionsTest-1505974574 Sep 15 13:09:19.665050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-VolumesActionsTest-1505974574-project Sep 15 13:09:19.665050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:09:19.665050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:09:19.665050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: 0fa77b2d0ace4ab3af23ec0a10e23ea1 Sep 15 13:09:19.665050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-VolumesActionsTest-1505974574-project Sep 15 13:09:19.665050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:09:19.665050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance bfe4588a-9924-44b1-ab03-c8635cea4160 could not be found. Sep 15 13:09:19.665050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': 'bfe4588a-9924-44b1-ab03-c8635cea4160'} Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfe4588a-9924-44b1-ab03-c8635cea4160 could not be found. Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:19.669349 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfe4588a-9924-44b1-ab03-c8635cea4160 could not be found. Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfe4588a-9924-44b1-ab03-c8635cea4160 could not be found. Sep 15 13:09:19.670686 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.671793 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-867c7b53-2380-4a3e-8cdb-72e4a3e998b6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Returning 404 to user: Instance bfe4588a-9924-44b1-ab03-c8635cea4160 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:19.671793 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-867c7b53-2380-4a3e-8cdb-72e4a3e998b6 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160" status: 404 len: 111 microversion: 2.1 time: 0.034709 Sep 15 13:09:19.671793 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 449/911] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:19 2022] GET /compute/v2.1/servers/bfe4588a-9924-44b1-ab03-c8635cea4160 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 13:09:19.696731 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-a4682055-a7ab-4646-adb5-a5e9db7e2ad1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] HTTP exception thrown: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a4682055-a7ab-4646-adb5-a5e9db7e2ad1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Request method failure captured: Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: DELETE /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb HTTP/1.1 Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyGGYRzHJ05hjHYgSTJM4m5vV4OGNuAzzTXy_b-nXNy4za0VZ8ff_XnOR0L6DEJjE1uvsP_b-yP7TJQWb3u16zemup6MPJKsdmr4ohzSITEb3JhwPOPdIbb5HINoAcXD1WmYgGLyGu3akKmPCYsqX6rCuqs4srW6XGS_xle_PrdIt3o Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 6180da28285943f7a7b0900185df6127 Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:09:19.698424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:09:19.700637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6180da28285943f7a7b0900185df6127", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6180da28285943f7a7b0900185df6127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6180da28285943f7a7b0900185df6127"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6180da28285943f7a7b0900185df6127"}]}] Sep 15 13:09:19.700637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:19.700637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 6180da28285943f7a7b0900185df6127 Sep 15 13:09:19.700637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:19.700637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-AttachVolumeShelveTestJSON-2136858861-project Sep 15 13:09:19.700637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:09:19.700637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:09:19.700637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 2f0feb7134ee408b989b398a315850fe Sep 15 13:09:19.700637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2136858861-project Sep 15 13:09:19.700637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:09:19.700637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:09:19.700637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '1777381a-01af-43ba-98dc-31bfeeded7bb'} Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:19.702144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:09:19.704119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.705684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a4682055-a7ab-4646-adb5-a5e9db7e2ad1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Returning 404 to user: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:19.705684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a4682055-a7ab-4646-adb5-a5e9db7e2ad1 tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 404 len: 111 microversion: 2.20 time: 0.184658 Sep 15 13:09:19.705684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 463/912] 10.222.0.57 () {60 vars in 1280 bytes} [Thu Sep 15 13:09:19 2022] DELETE /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 13:09:19.710257 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0a1e5acf-6168-4bdc-aaca-05fa62a71f0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:19.710956 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0a1e5acf-6168-4bdc-aaca-05fa62a71f0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] [instance: 1777381a-01af-43ba-98dc-31bfeeded7bb] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:19.718566 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a1e5acf-6168-4bdc-aaca-05fa62a71f0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:19.719297 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a1e5acf-6168-4bdc-aaca-05fa62a71f0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:19.719902 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a1e5acf-6168-4bdc-aaca-05fa62a71f0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:19.720712 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a1e5acf-6168-4bdc-aaca-05fa62a71f0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:19.721257 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a1e5acf-6168-4bdc-aaca-05fa62a71f0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:19.721757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0a1e5acf-6168-4bdc-aaca-05fa62a71f0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:19.736837 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-0a1e5acf-6168-4bdc-aaca-05fa62a71f0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] HTTP exception thrown: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0a1e5acf-6168-4bdc-aaca-05fa62a71f0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Request method failure captured: Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb HTTP/1.1 Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyGGYRzHJ05hjHYgSTJM4m5vV4OGNuAzzTXy_b-nXNy4za0VZ8ff_XnOR0L6DEJjE1uvsP_b-yP7TJQWb3u16zemup6MPJKsdmr4ohzSITEb3JhwPOPdIbb5HINoAcXD1WmYgGLyGu3akKmPCYsqX6rCuqs4srW6XGS_xle_PrdIt3o Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 6180da28285943f7a7b0900185df6127 Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:09:19.738587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:09:19.740376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6180da28285943f7a7b0900185df6127", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6180da28285943f7a7b0900185df6127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6180da28285943f7a7b0900185df6127"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6180da28285943f7a7b0900185df6127"}]}] Sep 15 13:09:19.740376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:19.740376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 6180da28285943f7a7b0900185df6127 Sep 15 13:09:19.740376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2136858861 Sep 15 13:09:19.740376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-AttachVolumeShelveTestJSON-2136858861-project Sep 15 13:09:19.740376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:09:19.740376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:09:19.740376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: 2f0feb7134ee408b989b398a315850fe Sep 15 13:09:19.740376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2136858861-project Sep 15 13:09:19.740376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:09:19.740376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:09:19.740376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': '1777381a-01af-43ba-98dc-31bfeeded7bb'} Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:19.741278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. Sep 15 13:09:19.742988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:19.744426 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0a1e5acf-6168-4bdc-aaca-05fa62a71f0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] Returning 404 to user: Instance 1777381a-01af-43ba-98dc-31bfeeded7bb could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:19.744426 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0a1e5acf-6168-4bdc-aaca-05fa62a71f0e tempest-AttachVolumeShelveTestJSON-2136858861 tempest-AttachVolumeShelveTestJSON-2136858861-project] 10.222.0.57 "GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb" status: 404 len: 111 microversion: 2.20 time: 0.034668 Sep 15 13:09:19.744426 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 450/913] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Sep 15 13:09:19 2022] GET /compute/v2.1/servers/1777381a-01af-43ba-98dc-31bfeeded7bb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 13:09:19.782513 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1935974083", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "networks": [{"uuid": "f23a539b-43b1-4641-ae2c-1eaa74646362"}]}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:19.843436 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.network.neutron [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] validate_networks() for [('f23a539b-43b1-4641-ae2c-1eaa74646362', None, None, None, None, None)] {{(pid=120633) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:09:20.510571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-3e5a61ae-2fd8-47a0-83da-6850f43a8da8 req-67945aff-ed4c-42b4-a47e-94d1906b3f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfe4588a-9924-44b1-ab03-c8635cea4160", "name": "network-vif-deleted", "tag": "009a471b-9402-4e82-9037-2675dee6dc22"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:20.521454 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-3e5a61ae-2fd8-47a0-83da-6850f43a8da8 req-67945aff-ed4c-42b4-a47e-94d1906b3f73 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:20.522683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-3e5a61ae-2fd8-47a0-83da-6850f43a8da8 req-67945aff-ed4c-42b4-a47e-94d1906b3f73 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:20.523133 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-3e5a61ae-2fd8-47a0-83da-6850f43a8da8 req-67945aff-ed4c-42b4-a47e-94d1906b3f73 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:20.536227 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-3e5a61ae-2fd8-47a0-83da-6850f43a8da8 req-67945aff-ed4c-42b4-a47e-94d1906b3f73 service nova] Creating event network-vif-deleted:009a471b-9402-4e82-9037-2675dee6dc22 for instance bfe4588a-9924-44b1-ab03-c8635cea4160 on hv-cinder-83608 Sep 15 13:09:20.541117 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-3e5a61ae-2fd8-47a0-83da-6850f43a8da8 req-67945aff-ed4c-42b4-a47e-94d1906b3f73 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034216 Sep 15 13:09:20.541816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 451/914] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:09:20.785101 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Flavor limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:09:20.785576 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Image limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:09:20.786153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Flavor pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:09:20.786591 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Image pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:09:20.786944 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:09:20.794430 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:20.803373 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:20.805240 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:20.805904 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:20.806891 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:20.807583 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:20.808566 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:20.820235 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:20.835226 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Getting quotas for project 9472f5867b964202af54362d390c7509. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:09:20.841053 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Getting quotas for user 0fa77b2d0ace4ab3af23ec0a10e23ea1 and project 9472f5867b964202af54362d390c7509. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:09:20.858552 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Going to run 1 instances... {{(pid=120633) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:09:20.860905 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:09:20.915314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-fcdd5daa-6920-456b-9645-c2dbb48db28b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.136357 Sep 15 13:09:20.915949 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 464/915] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:09:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 13:09:20.928143 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-269b29f3-ba4f-443e-b7b3-e1a09d4ccc47 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:20.929167 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-269b29f3-ba4f-443e-b7b3-e1a09d4ccc47 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:20.995125 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-269b29f3-ba4f-443e-b7b3-e1a09d4ccc47 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:21.002575 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-269b29f3-ba4f-443e-b7b3-e1a09d4ccc47 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1214 microversion: 2.1 time: 0.078826 Sep 15 13:09:21.003556 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 452/916] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:20 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:22.027120 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5f51faa5-4ea1-471d-9389-8a83bd12397b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:22.030615 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-5f51faa5-4ea1-471d-9389-8a83bd12397b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:22.038209 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f51faa5-4ea1-471d-9389-8a83bd12397b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:22.038946 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f51faa5-4ea1-471d-9389-8a83bd12397b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:22.039842 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f51faa5-4ea1-471d-9389-8a83bd12397b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:22.041000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f51faa5-4ea1-471d-9389-8a83bd12397b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:22.041752 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f51faa5-4ea1-471d-9389-8a83bd12397b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:22.042661 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5f51faa5-4ea1-471d-9389-8a83bd12397b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:22.131380 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-5f51faa5-4ea1-471d-9389-8a83bd12397b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:22.142795 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-5f51faa5-4ea1-471d-9389-8a83bd12397b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1266 microversion: 2.1 time: 0.120867 Sep 15 13:09:22.154430 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 465/917] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:22 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:23.167562 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e9a4100f-2310-4461-9c6b-70b2fe6fda1b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:23.169770 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-e9a4100f-2310-4461-9c6b-70b2fe6fda1b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:23.183411 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e9a4100f-2310-4461-9c6b-70b2fe6fda1b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:23.184402 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e9a4100f-2310-4461-9c6b-70b2fe6fda1b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:23.185018 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e9a4100f-2310-4461-9c6b-70b2fe6fda1b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:23.185963 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e9a4100f-2310-4461-9c6b-70b2fe6fda1b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:23.186655 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e9a4100f-2310-4461-9c6b-70b2fe6fda1b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:23.187077 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e9a4100f-2310-4461-9c6b-70b2fe6fda1b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:23.568489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e9a4100f-2310-4461-9c6b-70b2fe6fda1b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:23.584883 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e9a4100f-2310-4461-9c6b-70b2fe6fda1b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1314 microversion: 2.1 time: 0.421264 Sep 15 13:09:23.586329 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 453/918] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:23 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:09:24.445644 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-d304eedd-be0f-47e0-887c-0e694133e4e7 req-44fe4941-20f6-40c1-9cd3-8089d23f84b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d0ae9e-9285-4656-8d98-50fb2af638a8", "tag": "94f0aff7-db84-459c-98a3-27db0a23ce68"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:24.474550 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-d304eedd-be0f-47e0-887c-0e694133e4e7 req-44fe4941-20f6-40c1-9cd3-8089d23f84b3 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:24.475124 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-d304eedd-be0f-47e0-887c-0e694133e4e7 req-44fe4941-20f6-40c1-9cd3-8089d23f84b3 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:24.475748 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-d304eedd-be0f-47e0-887c-0e694133e4e7 req-44fe4941-20f6-40c1-9cd3-8089d23f84b3 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:24.490184 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-d304eedd-be0f-47e0-887c-0e694133e4e7 req-44fe4941-20f6-40c1-9cd3-8089d23f84b3 service nova] Creating event network-changed:94f0aff7-db84-459c-98a3-27db0a23ce68 for instance c3d0ae9e-9285-4656-8d98-50fb2af638a8 on hv-cinder-83608 Sep 15 13:09:24.497145 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-d304eedd-be0f-47e0-887c-0e694133e4e7 req-44fe4941-20f6-40c1-9cd3-8089d23f84b3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065647 Sep 15 13:09:24.498142 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 466/919] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:24.618406 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3fbfe06b-3a41-4b55-9e87-0e585c6afbda tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:24.619209 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3fbfe06b-3a41-4b55-9e87-0e585c6afbda tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:24.629300 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3fbfe06b-3a41-4b55-9e87-0e585c6afbda tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:24.630646 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3fbfe06b-3a41-4b55-9e87-0e585c6afbda tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:24.631267 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3fbfe06b-3a41-4b55-9e87-0e585c6afbda tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:24.632405 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3fbfe06b-3a41-4b55-9e87-0e585c6afbda tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:24.633446 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3fbfe06b-3a41-4b55-9e87-0e585c6afbda tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:24.634032 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3fbfe06b-3a41-4b55-9e87-0e585c6afbda tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:24.888082 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3fbfe06b-3a41-4b55-9e87-0e585c6afbda tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:24.897768 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3fbfe06b-3a41-4b55-9e87-0e585c6afbda tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1314 microversion: 2.1 time: 0.288246 Sep 15 13:09:24.898945 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 454/920] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:24 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:25.341205 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d4bc0d90-185f-4a24-ab64-be5cbfd0e895 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Action: 'create', calling method: .version_select at 0x7f62c540ec10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-976443270"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:25.644906 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d4bc0d90-185f-4a24-ab64-be5cbfd0e895 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.420426 Sep 15 13:09:25.645787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 467/921] 10.222.0.57 () {60 vars in 1155 bytes} [Thu Sep 15 13:09:25 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 422 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 15 13:09:25.658682 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-33449e50-c830-4506-acb3-ac64ac8b5b79 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c55c69d0>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:25.710628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-33449e50-c830-4506-acb3-ac64ac8b5b79 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c" status: 200 len: 344 microversion: 2.1 time: 0.055727 Sep 15 13:09:25.711246 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 455/922] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 13:09:25 2022] GET /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:25.923157 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-38a6049b-94d0-49bc-8a59-445f7cdb480a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:25.923897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-38a6049b-94d0-49bc-8a59-445f7cdb480a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:25.930997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-38a6049b-94d0-49bc-8a59-445f7cdb480a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:25.931477 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-38a6049b-94d0-49bc-8a59-445f7cdb480a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:25.931909 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-38a6049b-94d0-49bc-8a59-445f7cdb480a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:25.932642 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-38a6049b-94d0-49bc-8a59-445f7cdb480a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:25.933168 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-38a6049b-94d0-49bc-8a59-445f7cdb480a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:25.933494 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-38a6049b-94d0-49bc-8a59-445f7cdb480a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:26.077782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-38a6049b-94d0-49bc-8a59-445f7cdb480a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:26.087100 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-38a6049b-94d0-49bc-8a59-445f7cdb480a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1314 microversion: 2.1 time: 0.167771 Sep 15 13:09:26.087843 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 468/923] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:25 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:26.726041 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-41ee0f6f-2e5e-48f5-94ae-36f583a4ad19 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c8d6e550>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:26.775046 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-41ee0f6f-2e5e-48f5-94ae-36f583a4ad19 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c" status: 200 len: 345 microversion: 2.1 time: 0.053298 Sep 15 13:09:26.775719 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 456/924] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 13:09:26 2022] GET /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:26.789286 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f5e35cd7-ac4d-428b-8d35-a5b3b27a1283 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Action: 'create', calling method: .version_select at 0x7f62c53e8f70>, body: {"snapshot": {"volume_id": "1e6fd252-d713-44ab-8769-8a35fccfd07c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-989015176"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:26.948180 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f5e35cd7-ac4d-428b-8d35-a5b3b27a1283 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.162446 Sep 15 13:09:26.948808 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 469/925] 10.222.0.57 () {60 vars in 1162 bytes} [Thu Sep 15 13:09:26 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:26.961056 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-423c2a3e-e2b8-4f44-9884-94b3ff05bba0 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c8d6e0d0>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:26.992354 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-423c2a3e-e2b8-4f44-9884-94b3ff05bba0 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524" status: 200 len: 286 microversion: 2.1 time: 0.035661 Sep 15 13:09:26.993087 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 457/926] 10.222.0.57 () {58 vars in 1251 bytes} [Thu Sep 15 13:09:26 2022] GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:09:27.006142 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-62eb3351-a5fd-453a-bb89-06dc0abdae22 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c53ea9d0>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:27.039060 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-62eb3351-a5fd-453a-bb89-06dc0abdae22 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036754 Sep 15 13:09:27.039658 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 470/927] 10.222.0.57 () {58 vars in 1140 bytes} [Thu Sep 15 13:09:27 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:27.051187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1c5206f1-5fd2-4d6b-81bf-5d0f21940e3b tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c8e185e0>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:27.080434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1c5206f1-5fd2-4d6b-81bf-5d0f21940e3b tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524" status: 200 len: 286 microversion: 2.1 time: 0.032966 Sep 15 13:09:27.081083 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 458/928] 10.222.0.57 () {58 vars in 1251 bytes} [Thu Sep 15 13:09:27 2022] GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:27.112963 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-86662fe3-ebaf-4f96-bf8a-d2e33dfcfc41 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:27.113809 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-86662fe3-ebaf-4f96-bf8a-d2e33dfcfc41 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:27.120139 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-86662fe3-ebaf-4f96-bf8a-d2e33dfcfc41 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:27.120663 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-86662fe3-ebaf-4f96-bf8a-d2e33dfcfc41 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:27.121100 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-86662fe3-ebaf-4f96-bf8a-d2e33dfcfc41 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:27.121816 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-86662fe3-ebaf-4f96-bf8a-d2e33dfcfc41 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:27.122275 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-86662fe3-ebaf-4f96-bf8a-d2e33dfcfc41 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:27.122695 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-86662fe3-ebaf-4f96-bf8a-d2e33dfcfc41 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:27.256425 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-86662fe3-ebaf-4f96-bf8a-d2e33dfcfc41 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:27.264705 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-86662fe3-ebaf-4f96-bf8a-d2e33dfcfc41 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1314 microversion: 2.1 time: 0.156596 Sep 15 13:09:27.265268 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 471/929] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:27 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:09:28.094451 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-141ef422-1d81-4207-946f-8770342ffa0b tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c8d6e790>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:28.125733 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-141ef422-1d81-4207-946f-8770342ffa0b tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524" status: 200 len: 286 microversion: 2.1 time: 0.036381 Sep 15 13:09:28.126313 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 459/930] 10.222.0.57 () {58 vars in 1251 bytes} [Thu Sep 15 13:09:28 2022] GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:28.289891 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bb2ecb6b-2c15-43bd-86f2-10923a67f29a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:28.290510 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-bb2ecb6b-2c15-43bd-86f2-10923a67f29a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:28.297600 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bb2ecb6b-2c15-43bd-86f2-10923a67f29a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:28.298084 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bb2ecb6b-2c15-43bd-86f2-10923a67f29a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:28.298543 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bb2ecb6b-2c15-43bd-86f2-10923a67f29a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:28.299228 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bb2ecb6b-2c15-43bd-86f2-10923a67f29a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:28.299675 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bb2ecb6b-2c15-43bd-86f2-10923a67f29a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:28.300090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bb2ecb6b-2c15-43bd-86f2-10923a67f29a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:28.432700 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-bb2ecb6b-2c15-43bd-86f2-10923a67f29a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:28.440301 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-bb2ecb6b-2c15-43bd-86f2-10923a67f29a tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1314 microversion: 2.1 time: 0.154363 Sep 15 13:09:28.440859 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 472/931] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:28 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:29.140180 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5032a246-85c0-45c0-8321-d1d76fb839ef tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c54d7a60>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:29.169570 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5032a246-85c0-45c0-8321-d1d76fb839ef tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524" status: 200 len: 286 microversion: 2.1 time: 0.034464 Sep 15 13:09:29.170644 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 460/932] 10.222.0.57 () {58 vars in 1251 bytes} [Thu Sep 15 13:09:29 2022] GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:29.463817 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a5eb4a58-0b2a-4239-9d18-70b73e93ed39 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:29.464557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a5eb4a58-0b2a-4239-9d18-70b73e93ed39 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:29.471507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5eb4a58-0b2a-4239-9d18-70b73e93ed39 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:29.471997 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5eb4a58-0b2a-4239-9d18-70b73e93ed39 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:29.472466 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5eb4a58-0b2a-4239-9d18-70b73e93ed39 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:29.473174 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5eb4a58-0b2a-4239-9d18-70b73e93ed39 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:29.473630 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5eb4a58-0b2a-4239-9d18-70b73e93ed39 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:29.474053 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a5eb4a58-0b2a-4239-9d18-70b73e93ed39 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:29.613369 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a5eb4a58-0b2a-4239-9d18-70b73e93ed39 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:29.620994 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a5eb4a58-0b2a-4239-9d18-70b73e93ed39 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1314 microversion: 2.1 time: 0.161247 Sep 15 13:09:29.622033 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 473/933] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:29 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:30.184200 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c5c368b3-c94e-4562-84f4-c56a2b660920 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c6239c10>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:30.214496 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c5c368b3-c94e-4562-84f4-c56a2b660920 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524" status: 200 len: 286 microversion: 2.1 time: 0.034511 Sep 15 13:09:30.215077 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 461/934] 10.222.0.57 () {58 vars in 1251 bytes} [Thu Sep 15 13:09:30 2022] GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:30.645667 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-16510299-55f3-4c63-8f67-9a8a4a61fa34 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:30.646287 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-16510299-55f3-4c63-8f67-9a8a4a61fa34 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:30.653072 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-16510299-55f3-4c63-8f67-9a8a4a61fa34 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:30.653557 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-16510299-55f3-4c63-8f67-9a8a4a61fa34 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:30.653986 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-16510299-55f3-4c63-8f67-9a8a4a61fa34 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:30.654687 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-16510299-55f3-4c63-8f67-9a8a4a61fa34 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:30.655138 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-16510299-55f3-4c63-8f67-9a8a4a61fa34 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:30.655550 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-16510299-55f3-4c63-8f67-9a8a4a61fa34 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:30.789311 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-16510299-55f3-4c63-8f67-9a8a4a61fa34 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:30.797455 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-16510299-55f3-4c63-8f67-9a8a4a61fa34 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1314 microversion: 2.1 time: 0.155678 Sep 15 13:09:30.798019 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 474/935] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:30 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:31.226441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:31.230710 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-44d649fc-9b42-4d09-9cab-7768d256734d tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c8e18e50>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:31.261004 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-44d649fc-9b42-4d09-9cab-7768d256734d tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524" status: 200 len: 286 microversion: 2.1 time: 0.035412 Sep 15 13:09:31.261567 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 462/936] 10.222.0.57 () {58 vars in 1251 bytes} [Thu Sep 15 13:09:31 2022] GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:31.821009 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2d55fe2d-4a3c-4c03-8281-e75b843b7cdd tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:31.821661 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2d55fe2d-4a3c-4c03-8281-e75b843b7cdd tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:31.823336 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:31.823977 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=6 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:31.831850 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2d55fe2d-4a3c-4c03-8281-e75b843b7cdd tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:31.832359 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2d55fe2d-4a3c-4c03-8281-e75b843b7cdd tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:31.832798 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2d55fe2d-4a3c-4c03-8281-e75b843b7cdd tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:31.833495 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2d55fe2d-4a3c-4c03-8281-e75b843b7cdd tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:31.833939 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2d55fe2d-4a3c-4c03-8281-e75b843b7cdd tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:31.834354 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2d55fe2d-4a3c-4c03-8281-e75b843b7cdd tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:31.964173 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2d55fe2d-4a3c-4c03-8281-e75b843b7cdd tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:31.971837 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2d55fe2d-4a3c-4c03-8281-e75b843b7cdd tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1314 microversion: 2.1 time: 0.154876 Sep 15 13:09:31.972449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 475/937] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:31 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:32.275766 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-55e7c9de-d592-45ea-86d6-fc036644c101 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c8cda700>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:32.305881 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-55e7c9de-d592-45ea-86d6-fc036644c101 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524" status: 200 len: 286 microversion: 2.1 time: 0.034746 Sep 15 13:09:32.306441 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 463/938] 10.222.0.57 () {58 vars in 1251 bytes} [Thu Sep 15 13:09:32 2022] GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:32.994389 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c814ac31-fb34-44ed-8a6e-a9de90241331 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:32.995068 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c814ac31-fb34-44ed-8a6e-a9de90241331 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:33.001962 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c814ac31-fb34-44ed-8a6e-a9de90241331 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:33.002442 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c814ac31-fb34-44ed-8a6e-a9de90241331 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:33.002904 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c814ac31-fb34-44ed-8a6e-a9de90241331 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:33.003606 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c814ac31-fb34-44ed-8a6e-a9de90241331 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:33.004075 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c814ac31-fb34-44ed-8a6e-a9de90241331 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:33.004531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c814ac31-fb34-44ed-8a6e-a9de90241331 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:33.135644 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c814ac31-fb34-44ed-8a6e-a9de90241331 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:33.145483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c814ac31-fb34-44ed-8a6e-a9de90241331 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1314 microversion: 2.1 time: 0.154874 Sep 15 13:09:33.146081 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 476/939] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:32 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:33.319601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-50955a60-b7f5-44b7-b3ea-aa75aa3fcc52 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c8e20d30>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:33.349984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-50955a60-b7f5-44b7-b3ea-aa75aa3fcc52 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524" status: 200 len: 287 microversion: 2.1 time: 0.034801 Sep 15 13:09:33.350896 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 464/940] 10.222.0.57 () {58 vars in 1251 bytes} [Thu Sep 15 13:09:33 2022] GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:33.365024 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2038cb96-d582-4e94-893e-dc007fb44080 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c547fa60>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:33.428023 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2038cb96-d582-4e94-893e-dc007fb44080 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524" status: 202 len: 0 microversion: 2.1 time: 0.066895 Sep 15 13:09:33.428891 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 477/941] 10.222.0.57 () {58 vars in 1254 bytes} [Thu Sep 15 13:09:33 2022] DELETE /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:09:33.436903 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f12b6c34-3145-46fb-a465-18ff5670b637 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c564faf0>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:33.467655 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f12b6c34-3145-46fb-a465-18ff5670b637 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524" status: 200 len: 286 microversion: 2.1 time: 0.033896 Sep 15 13:09:33.468548 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 465/942] 10.222.0.57 () {58 vars in 1251 bytes} [Thu Sep 15 13:09:33 2022] GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:34.170842 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-372ddccf-ef0d-4125-b24b-9d2f971a024b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:34.171488 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-372ddccf-ef0d-4125-b24b-9d2f971a024b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:34.177379 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-372ddccf-ef0d-4125-b24b-9d2f971a024b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:34.177914 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-372ddccf-ef0d-4125-b24b-9d2f971a024b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:34.178295 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-372ddccf-ef0d-4125-b24b-9d2f971a024b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:34.178980 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-372ddccf-ef0d-4125-b24b-9d2f971a024b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:34.179430 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-372ddccf-ef0d-4125-b24b-9d2f971a024b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:34.179855 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-372ddccf-ef0d-4125-b24b-9d2f971a024b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:34.320972 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-372ddccf-ef0d-4125-b24b-9d2f971a024b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:34.328869 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-372ddccf-ef0d-4125-b24b-9d2f971a024b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1314 microversion: 2.1 time: 0.163030 Sep 15 13:09:34.329427 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 478/943] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:34 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:34.481057 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-47a81091-1aec-4620-927c-7b810562cd83 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c8cda550>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:34.505721 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-47a81091-1aec-4620-927c-7b810562cd83 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] HTTP exception thrown: Snapshot fa5866ca-1728-445e-bb20-a7a910c30524 could not be found. Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-47a81091-1aec-4620-927c-7b810562cd83 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Request method failure captured: Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524 HTTP/1.1 Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyQFjYHMQ1xpJ9YmlqlWsWv3dldck2Qs8JKnd1B6TGFug4JvT_pNVquz1UtQQs_qYny6NptzHTauXF2P-FTLiy9rPxOOy8osttFe1AaW1KgVZEI2FcA4l2fZ1K6I-XVynhdapBDEFyTLIG_nupCjm8tuKFqvZOUMjKZ1-g1neXL33WQ Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: bc559da8928a4f909f86dba1c455472c Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1362227576 Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:09:34.508968 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:09:34.510547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bc559da8928a4f909f86dba1c455472c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bc559da8928a4f909f86dba1c455472c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bc559da8928a4f909f86dba1c455472c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bc559da8928a4f909f86dba1c455472c"}]}] Sep 15 13:09:34.510547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1362227576 Sep 15 13:09:34.510547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: bc559da8928a4f909f86dba1c455472c Sep 15 13:09:34.510547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1362227576 Sep 15 13:09:34.510547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-VolumesSnapshotsTestJSON-1362227576-project Sep 15 13:09:34.510547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:09:34.510547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:09:34.510547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: 2687e887c3f349fbae1bd1d83b4e7a67 Sep 15 13:09:34.510547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1362227576-project Sep 15 13:09:34.510547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: Sep 15 13:09:34.510547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Snapshot fa5866ca-1728-445e-bb20-a7a910c30524 could not be found. Sep 15 13:09:34.510547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': 'fa5866ca-1728-445e-bb20-a7a910c30524'} Sep 15 13:09:34.510547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fa5866ca-1728-445e-bb20-a7a910c30524 could not be found. (HTTP 404) (Request-ID: req-c30d5ccb-e869-4ef2-839e-c169ad1ecc11) Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:34.511489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 13:09:34.512814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fa5866ca-1728-445e-bb20-a7a910c30524 could not be found. Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 15 13:09:34.514551 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:34.516648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fa5866ca-1728-445e-bb20-a7a910c30524 could not be found. Sep 15 13:09:34.516648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:34.516648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:34.516648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:34.516648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:34.516648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:34.516648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:34.516648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:34.516648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:34.516648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fa5866ca-1728-445e-bb20-a7a910c30524 could not be found. Sep 15 13:09:34.516648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:34.516648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-47a81091-1aec-4620-927c-7b810562cd83 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Returning 404 to user: Snapshot fa5866ca-1728-445e-bb20-a7a910c30524 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:34.516648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-47a81091-1aec-4620-927c-7b810562cd83 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524" status: 404 len: 111 microversion: 2.1 time: 0.033829 Sep 15 13:09:34.518045 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 466/944] 10.222.0.57 () {58 vars in 1251 bytes} [Thu Sep 15 13:09:34 2022] GET /compute/v2.1/os-snapshots/fa5866ca-1728-445e-bb20-a7a910c30524 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:09:34.520959 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-101aeb8f-237d-4ed3-a25b-ea6b84cdd13a tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c547fe50>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:34.589392 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-101aeb8f-237d-4ed3-a25b-ea6b84cdd13a tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c" status: 202 len: 0 microversion: 2.1 time: 0.072723 Sep 15 13:09:34.589959 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 479/945] 10.222.0.57 () {58 vars in 1248 bytes} [Thu Sep 15 13:09:34 2022] DELETE /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:09:34.598624 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a2dbfe8d-6652-47bb-9f9e-bb177fd138ae tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c54d5700>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:34.629278 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:34.648047 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a2dbfe8d-6652-47bb-9f9e-bb177fd138ae tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c" status: 200 len: 344 microversion: 2.1 time: 0.053114 Sep 15 13:09:34.648650 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 467/946] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 13:09:34 2022] GET /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:34.886438 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-aff93c2d-b45f-4c6f-828b-aaefffc30e9a req-485479bf-9ada-4ab5-92e2-5ff34c779440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d0ae9e-9285-4656-8d98-50fb2af638a8", "name": "network-vif-plugged", "status": "completed", "tag": "94f0aff7-db84-459c-98a3-27db0a23ce68"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:34.897520 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-aff93c2d-b45f-4c6f-828b-aaefffc30e9a req-485479bf-9ada-4ab5-92e2-5ff34c779440 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:34.898003 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-aff93c2d-b45f-4c6f-828b-aaefffc30e9a req-485479bf-9ada-4ab5-92e2-5ff34c779440 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:34.898434 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-aff93c2d-b45f-4c6f-828b-aaefffc30e9a req-485479bf-9ada-4ab5-92e2-5ff34c779440 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:34.910868 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-aff93c2d-b45f-4c6f-828b-aaefffc30e9a req-485479bf-9ada-4ab5-92e2-5ff34c779440 service nova] Creating event network-vif-plugged:94f0aff7-db84-459c-98a3-27db0a23ce68 for instance c3d0ae9e-9285-4656-8d98-50fb2af638a8 on hv-cinder-83608 Sep 15 13:09:34.915704 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-aff93c2d-b45f-4c6f-828b-aaefffc30e9a req-485479bf-9ada-4ab5-92e2-5ff34c779440 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032977 Sep 15 13:09:34.916324 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 480/947] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:35.354134 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=57 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:35.358518 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ab5f61c3-229f-4ad3-8910-336dc04a3b08 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:35.359194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ab5f61c3-229f-4ad3-8910-336dc04a3b08 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:35.367243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ab5f61c3-229f-4ad3-8910-336dc04a3b08 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:35.367905 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ab5f61c3-229f-4ad3-8910-336dc04a3b08 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:35.368387 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ab5f61c3-229f-4ad3-8910-336dc04a3b08 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:35.369234 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ab5f61c3-229f-4ad3-8910-336dc04a3b08 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:35.369695 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ab5f61c3-229f-4ad3-8910-336dc04a3b08 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:35.370122 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-ab5f61c3-229f-4ad3-8910-336dc04a3b08 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:35.503410 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ab5f61c3-229f-4ad3-8910-336dc04a3b08 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:35.511029 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ab5f61c3-229f-4ad3-8910-336dc04a3b08 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1314 microversion: 2.1 time: 0.157665 Sep 15 13:09:35.511592 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 468/948] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:35 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:35.664776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-84981fe3-9320-49aa-8270-7534ccaa095a tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c547fe50>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:35.694731 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-84981fe3-9320-49aa-8270-7534ccaa095a tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] HTTP exception thrown: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-84981fe3-9320-49aa-8270-7534ccaa095a tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Request method failure captured: Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c HTTP/1.1 Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyQFjYHMQ1xpJ9YmlqlWsWv3dldck2Qs8JKnd1B6TGFug4JvT_pNVquz1UtQQs_qYny6NptzHTauXF2P-FTLiy9rPxOOy8osttFe1AaW1KgVZEI2FcA4l2fZ1K6I-XVynhdapBDEFyTLIG_nupCjm8tuKFqvZOUMjKZ1-g1neXL33WQ Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: bc559da8928a4f909f86dba1c455472c Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1362227576 Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:09:35.696847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:09:35.698474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bc559da8928a4f909f86dba1c455472c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bc559da8928a4f909f86dba1c455472c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bc559da8928a4f909f86dba1c455472c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bc559da8928a4f909f86dba1c455472c"}]}] Sep 15 13:09:35.698474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1362227576 Sep 15 13:09:35.698474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: bc559da8928a4f909f86dba1c455472c Sep 15 13:09:35.698474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1362227576 Sep 15 13:09:35.698474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-VolumesSnapshotsTestJSON-1362227576-project Sep 15 13:09:35.698474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:09:35.698474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:09:35.698474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 2687e887c3f349fbae1bd1d83b4e7a67 Sep 15 13:09:35.698474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1362227576-project Sep 15 13:09:35.698474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: Sep 15 13:09:35.698474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.698474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '1e6fd252-d713-44ab-8769-8a35fccfd07c'} Sep 15 13:09:35.698474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. (HTTP 404) (Request-ID: req-c2f9a630-a584-444a-9827-8be7485addcb) Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:35.699396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 13:09:35.700629 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 13:09:35.701787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:35.702932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.702932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.702932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:35.702932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.702932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:35.702932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:35.702932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:35.702932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:35.702932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:35.702932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.702932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.702932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-84981fe3-9320-49aa-8270-7534ccaa095a tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Returning 404 to user: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:35.702932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-84981fe3-9320-49aa-8270-7534ccaa095a tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c" status: 404 len: 109 microversion: 2.1 time: 0.038256 Sep 15 13:09:35.702932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 481/949] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 13:09:35 2022] GET /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:09:35.712490 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a45fab82-80e3-4236-ab45-cf4748032ac1 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c8d6ed30>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:35.742654 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-a45fab82-80e3-4236-ab45-cf4748032ac1 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] HTTP exception thrown: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a45fab82-80e3-4236-ab45-cf4748032ac1 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Request method failure captured: Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: DELETE /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c HTTP/1.1 Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyQFjYHMQ1xpJ9YmlqlWsWv3dldck2Qs8JKnd1B6TGFug4JvT_pNVquz1UtQQs_qYny6NptzHTauXF2P-FTLiy9rPxOOy8osttFe1AaW1KgVZEI2FcA4l2fZ1K6I-XVynhdapBDEFyTLIG_nupCjm8tuKFqvZOUMjKZ1-g1neXL33WQ Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: bc559da8928a4f909f86dba1c455472c Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1362227576 Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:09:35.744964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:09:35.746549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bc559da8928a4f909f86dba1c455472c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bc559da8928a4f909f86dba1c455472c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bc559da8928a4f909f86dba1c455472c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bc559da8928a4f909f86dba1c455472c"}]}] Sep 15 13:09:35.746549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1362227576 Sep 15 13:09:35.746549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: bc559da8928a4f909f86dba1c455472c Sep 15 13:09:35.746549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1362227576 Sep 15 13:09:35.746549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-VolumesSnapshotsTestJSON-1362227576-project Sep 15 13:09:35.746549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:09:35.746549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:09:35.746549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: 2687e887c3f349fbae1bd1d83b4e7a67 Sep 15 13:09:35.746549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1362227576-project Sep 15 13:09:35.746549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: Sep 15 13:09:35.746549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.746549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': '1e6fd252-d713-44ab-8769-8a35fccfd07c'} Sep 15 13:09:35.746549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. (HTTP 404) (Request-ID: req-2b9c499e-f86a-44a2-8f22-1c6bd96f2ad8) Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:35.751025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 13:09:35.752526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 13:09:35.753977 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:35.755443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.755443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.755443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:35.755443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.755443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:35.755443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:35.755443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:35.755443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:35.755443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:35.755443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.755443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.755443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a45fab82-80e3-4236-ab45-cf4748032ac1 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Returning 404 to user: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:35.755443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a45fab82-80e3-4236-ab45-cf4748032ac1 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c" status: 404 len: 109 microversion: 2.1 time: 0.037727 Sep 15 13:09:35.755443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 469/950] 10.222.0.57 () {58 vars in 1248 bytes} [Thu Sep 15 13:09:35 2022] DELETE /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:09:35.757837 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a62f53ea-fe2f-43c2-aa83-5cc19941b2f4 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Calling method '.version_select at 0x7f62c71483a0>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:35.785562 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-a62f53ea-fe2f-43c2-aa83-5cc19941b2f4 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] HTTP exception thrown: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a62f53ea-fe2f-43c2-aa83-5cc19941b2f4 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Request method failure captured: Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c HTTP/1.1 Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyQFjYHMQ1xpJ9YmlqlWsWv3dldck2Qs8JKnd1B6TGFug4JvT_pNVquz1UtQQs_qYny6NptzHTauXF2P-FTLiy9rPxOOy8osttFe1AaW1KgVZEI2FcA4l2fZ1K6I-XVynhdapBDEFyTLIG_nupCjm8tuKFqvZOUMjKZ1-g1neXL33WQ Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: bc559da8928a4f909f86dba1c455472c Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1362227576 Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:09:35.787654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:09:35.789493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bc559da8928a4f909f86dba1c455472c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bc559da8928a4f909f86dba1c455472c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bc559da8928a4f909f86dba1c455472c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bc559da8928a4f909f86dba1c455472c"}]}] Sep 15 13:09:35.789493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1362227576 Sep 15 13:09:35.789493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: bc559da8928a4f909f86dba1c455472c Sep 15 13:09:35.789493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1362227576 Sep 15 13:09:35.789493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-VolumesSnapshotsTestJSON-1362227576-project Sep 15 13:09:35.789493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:09:35.789493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:09:35.789493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 2687e887c3f349fbae1bd1d83b4e7a67 Sep 15 13:09:35.789493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1362227576-project Sep 15 13:09:35.789493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: Sep 15 13:09:35.789493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.789493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': '1e6fd252-d713-44ab-8769-8a35fccfd07c'} Sep 15 13:09:35.789493 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. (HTTP 404) (Request-ID: req-ad5f4510-a8e3-4626-81e5-816f8be4f9ed) Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:35.790610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 13:09:35.792110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 13:09:35.793696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:35.795889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.795889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.795889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:35.795889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.795889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:35.795889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:35.795889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:35.795889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:35.795889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:35.795889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. Sep 15 13:09:35.795889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:35.795889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a62f53ea-fe2f-43c2-aa83-5cc19941b2f4 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] Returning 404 to user: Volume 1e6fd252-d713-44ab-8769-8a35fccfd07c could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:35.795889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a62f53ea-fe2f-43c2-aa83-5cc19941b2f4 tempest-VolumesSnapshotsTestJSON-1362227576 tempest-VolumesSnapshotsTestJSON-1362227576-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c" status: 404 len: 109 microversion: 2.1 time: 0.037728 Sep 15 13:09:35.795889 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 482/951] 10.222.0.57 () {58 vars in 1245 bytes} [Thu Sep 15 13:09:35 2022] GET /compute/v2.1/os-volumes/1e6fd252-d713-44ab-8769-8a35fccfd07c => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 13:09:36.537758 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-7d8d7492-d4fe-41d9-b3f7-5d96fd8940cf tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:36.538992 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-7d8d7492-d4fe-41d9-b3f7-5d96fd8940cf tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:36.549243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7d8d7492-d4fe-41d9-b3f7-5d96fd8940cf tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:36.550204 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7d8d7492-d4fe-41d9-b3f7-5d96fd8940cf tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:36.550870 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7d8d7492-d4fe-41d9-b3f7-5d96fd8940cf tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:36.552055 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7d8d7492-d4fe-41d9-b3f7-5d96fd8940cf tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:36.552789 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7d8d7492-d4fe-41d9-b3f7-5d96fd8940cf tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:36.553383 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7d8d7492-d4fe-41d9-b3f7-5d96fd8940cf tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:36.705749 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-7d8d7492-d4fe-41d9-b3f7-5d96fd8940cf tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:36.716988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-7d8d7492-d4fe-41d9-b3f7-5d96fd8940cf tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1314 microversion: 2.1 time: 0.181197 Sep 15 13:09:36.717748 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 470/952] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:36 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:37.740978 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cf490c30-de82-4db2-9910-63313917a23f tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:37.741920 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cf490c30-de82-4db2-9910-63313917a23f tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:37.748834 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf490c30-de82-4db2-9910-63313917a23f tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:37.749424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf490c30-de82-4db2-9910-63313917a23f tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:37.749922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf490c30-de82-4db2-9910-63313917a23f tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:37.750675 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf490c30-de82-4db2-9910-63313917a23f tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:37.751131 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf490c30-de82-4db2-9910-63313917a23f tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:37.751583 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cf490c30-de82-4db2-9910-63313917a23f tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:37.894393 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cf490c30-de82-4db2-9910-63313917a23f tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:37.902371 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cf490c30-de82-4db2-9910-63313917a23f tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1499 microversion: 2.1 time: 0.165775 Sep 15 13:09:37.903015 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 483/953] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:37 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1499 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:38.574034 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-dcd17edb-19ef-4d6a-98ef-7fb38edba149 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:38.574563 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-dcd17edb-19ef-4d6a-98ef-7fb38edba149 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:38.581458 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dcd17edb-19ef-4d6a-98ef-7fb38edba149 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:38.581697 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dcd17edb-19ef-4d6a-98ef-7fb38edba149 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:38.582138 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dcd17edb-19ef-4d6a-98ef-7fb38edba149 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:38.582838 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dcd17edb-19ef-4d6a-98ef-7fb38edba149 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:38.583295 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dcd17edb-19ef-4d6a-98ef-7fb38edba149 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:38.583723 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dcd17edb-19ef-4d6a-98ef-7fb38edba149 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:38.610614 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-dcd17edb-19ef-4d6a-98ef-7fb38edba149 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Going to try to terminate instance {{(pid=120634) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:09:38.689633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-dcd17edb-19ef-4d6a-98ef-7fb38edba149 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 204 len: 0 microversion: 2.1 time: 0.119295 Sep 15 13:09:38.690226 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 471/954] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:09:38 2022] DELETE /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:09:38.698728 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-99445ee0-705f-43dc-8e9e-f34eef81358b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:38.699610 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-99445ee0-705f-43dc-8e9e-f34eef81358b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:38.706458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-99445ee0-705f-43dc-8e9e-f34eef81358b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:38.706947 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-99445ee0-705f-43dc-8e9e-f34eef81358b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:38.707382 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-99445ee0-705f-43dc-8e9e-f34eef81358b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:38.708075 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-99445ee0-705f-43dc-8e9e-f34eef81358b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:38.708555 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-99445ee0-705f-43dc-8e9e-f34eef81358b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:38.709090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-99445ee0-705f-43dc-8e9e-f34eef81358b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:38.881787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-99445ee0-705f-43dc-8e9e-f34eef81358b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:38.889991 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-99445ee0-705f-43dc-8e9e-f34eef81358b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1505 microversion: 2.1 time: 0.195353 Sep 15 13:09:38.890615 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 484/955] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:38 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:39.915546 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3bca53d4-59ac-493a-ac89-0ff7ecddea92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:39.916249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3bca53d4-59ac-493a-ac89-0ff7ecddea92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:39.923146 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3bca53d4-59ac-493a-ac89-0ff7ecddea92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:39.923629 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3bca53d4-59ac-493a-ac89-0ff7ecddea92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:39.924065 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3bca53d4-59ac-493a-ac89-0ff7ecddea92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:39.924785 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3bca53d4-59ac-493a-ac89-0ff7ecddea92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:39.925239 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3bca53d4-59ac-493a-ac89-0ff7ecddea92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:39.925682 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3bca53d4-59ac-493a-ac89-0ff7ecddea92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:40.062943 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3bca53d4-59ac-493a-ac89-0ff7ecddea92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:40.072524 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3bca53d4-59ac-493a-ac89-0ff7ecddea92 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1505 microversion: 2.1 time: 0.161099 Sep 15 13:09:40.073634 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 472/956] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:39 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:41.085777 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-c8614476-05ab-47b8-a569-2e0a532c3efc req-26a39581-6137-495a-86b4-5c17d3d9bfc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d0ae9e-9285-4656-8d98-50fb2af638a8", "name": "network-vif-deleted", "tag": "94f0aff7-db84-459c-98a3-27db0a23ce68"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:09:41.097225 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-c8614476-05ab-47b8-a569-2e0a532c3efc req-26a39581-6137-495a-86b4-5c17d3d9bfc3 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:41.097721 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-c8614476-05ab-47b8-a569-2e0a532c3efc req-26a39581-6137-495a-86b4-5c17d3d9bfc3 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:41.098140 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-c8614476-05ab-47b8-a569-2e0a532c3efc req-26a39581-6137-495a-86b4-5c17d3d9bfc3 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:41.098857 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-69729bbc-860f-4ef6-856f-37271b298887 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:41.099631 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-69729bbc-860f-4ef6-856f-37271b298887 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:41.107315 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69729bbc-860f-4ef6-856f-37271b298887 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:41.108958 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69729bbc-860f-4ef6-856f-37271b298887 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:41.109628 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69729bbc-860f-4ef6-856f-37271b298887 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:41.110556 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69729bbc-860f-4ef6-856f-37271b298887 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:41.111215 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69729bbc-860f-4ef6-856f-37271b298887 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:41.111355 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-c8614476-05ab-47b8-a569-2e0a532c3efc req-26a39581-6137-495a-86b4-5c17d3d9bfc3 service nova] Creating event network-vif-deleted:94f0aff7-db84-459c-98a3-27db0a23ce68 for instance c3d0ae9e-9285-4656-8d98-50fb2af638a8 on hv-cinder-83608 Sep 15 13:09:41.112075 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69729bbc-860f-4ef6-856f-37271b298887 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:41.116558 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-c8614476-05ab-47b8-a569-2e0a532c3efc req-26a39581-6137-495a-86b4-5c17d3d9bfc3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034337 Sep 15 13:09:41.117492 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 485/957] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:09:41.176079 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-69729bbc-860f-4ef6-856f-37271b298887 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa77b2d0ace4ab3af23ec0a10e23ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9472f5867b964202af54362d390c7509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:09:41.183806 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-69729bbc-860f-4ef6-856f-37271b298887 tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 200 len: 1299 microversion: 2.1 time: 0.089188 Sep 15 13:09:41.184442 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 473/958] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:41 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:09:42.207643 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d69e1b2f-d5dd-411c-9f0c-8cc43c551d4b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:09:42.208354 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d69e1b2f-d5dd-411c-9f0c-8cc43c551d4b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] [instance: c3d0ae9e-9285-4656-8d98-50fb2af638a8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:09:42.214368 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d69e1b2f-d5dd-411c-9f0c-8cc43c551d4b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:42.214885 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d69e1b2f-d5dd-411c-9f0c-8cc43c551d4b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:42.215280 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d69e1b2f-d5dd-411c-9f0c-8cc43c551d4b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:42.216018 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d69e1b2f-d5dd-411c-9f0c-8cc43c551d4b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:09:42.216447 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d69e1b2f-d5dd-411c-9f0c-8cc43c551d4b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:09:42.216873 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d69e1b2f-d5dd-411c-9f0c-8cc43c551d4b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:09:42.231081 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-d69e1b2f-d5dd-411c-9f0c-8cc43c551d4b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] HTTP exception thrown: Instance c3d0ae9e-9285-4656-8d98-50fb2af638a8 could not be found. Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d69e1b2f-d5dd-411c-9f0c-8cc43c551d4b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Request method failure captured: Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 HTTP/1.1 Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyPsRZPeq48tkkttUdD8f8ZMqTfxegmnPNxDpVWKdatTYktxiUjRYcw_CzI74G7coI2OaNnzdb7ex-cXLVaxpfWGdKHiv4zQKeeuCqXh9wRYryxwvS124BdmuVJG5qJHMaDqNisjzcesKCrKXZpcQ9kHJg-aoURrX8SgQhQRhuC5UDc Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 9472f5867b964202af54362d390c7509 Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-VolumesActionsTest-1505974574 Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:09:42.232741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:09:42.235253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9472f5867b964202af54362d390c7509", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9472f5867b964202af54362d390c7509"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9472f5867b964202af54362d390c7509"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9472f5867b964202af54362d390c7509"}]}] Sep 15 13:09:42.235253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-VolumesActionsTest-1505974574 Sep 15 13:09:42.235253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 9472f5867b964202af54362d390c7509 Sep 15 13:09:42.235253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-VolumesActionsTest-1505974574 Sep 15 13:09:42.235253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-VolumesActionsTest-1505974574-project Sep 15 13:09:42.235253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:09:42.235253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:09:42.235253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 0fa77b2d0ace4ab3af23ec0a10e23ea1 Sep 15 13:09:42.235253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-VolumesActionsTest-1505974574-project Sep 15 13:09:42.235253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:09:42.235253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance c3d0ae9e-9285-4656-8d98-50fb2af638a8 could not be found. Sep 15 13:09:42.235253 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': 'c3d0ae9e-9285-4656-8d98-50fb2af638a8'} Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d0ae9e-9285-4656-8d98-50fb2af638a8 could not be found. Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:09:42.236164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d0ae9e-9285-4656-8d98-50fb2af638a8 could not be found. Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d0ae9e-9285-4656-8d98-50fb2af638a8 could not be found. Sep 15 13:09:42.237483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:09:42.238664 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d69e1b2f-d5dd-411c-9f0c-8cc43c551d4b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] Returning 404 to user: Instance c3d0ae9e-9285-4656-8d98-50fb2af638a8 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:09:42.238664 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d69e1b2f-d5dd-411c-9f0c-8cc43c551d4b tempest-VolumesActionsTest-1505974574 tempest-VolumesActionsTest-1505974574-project] 10.222.0.57 "GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8" status: 404 len: 111 microversion: 2.1 time: 0.031935 Sep 15 13:09:42.238664 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 486/959] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:09:42 2022] GET /compute/v2.1/servers/c3d0ae9e-9285-4656-8d98-50fb2af638a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:10:09.883614 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1649247420", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:10:09.907367 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:09.908554 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:09.946156 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.network.neutron [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] validate_networks() for None {{(pid=120634) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:10:10.212858 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Flavor limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:10:10.213276 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Image limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:10:10.213774 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Flavor pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:10:10.214181 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Image pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:10:10.214588 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:10:10.224930 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:10.225412 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:10.225844 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:10.226570 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:10.227022 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:10.227446 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:10.243971 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Getting quotas for project 8bec5f3334484051b6b6f4c0ee848e8f. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:10:10.247897 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Getting quotas for user e23717cb21e24f7cb23ec936b90ffd42 and project 8bec5f3334484051b6b6f4c0ee848e8f. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:10:10.258688 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Going to run 1 instances... {{(pid=120634) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:10:10.260974 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120634) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:10:10.304614 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-31127eb5-6e33-43df-923c-f7a1c85a9c2f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.427200 Sep 15 13:10:10.305267 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 474/960] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:10:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 13:10:10.316570 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-323263aa-519f-4bd7-9ae0-54399d516889 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:10.317181 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-323263aa-519f-4bd7-9ae0-54399d516889 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:10.319289 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:10.319927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=75 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:10.376066 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-323263aa-519f-4bd7-9ae0-54399d516889 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:10.385000 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-323263aa-519f-4bd7-9ae0-54399d516889 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1215 microversion: 2.1 time: 0.072046 Sep 15 13:10:10.385659 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 487/961] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:10 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:11.021161 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-396481265", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "networks": [{"uuid": "dfb75596-7d80-4835-8571-ad93dfcc0300"}]}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:10:11.076499 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.network.neutron [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] validate_networks() for [('dfb75596-7d80-4835-8571-ad93dfcc0300', None, None, None, None, None)] {{(pid=120634) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:10:11.409910 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-81c92ec4-2b2d-441c-b3b9-82a38798646b tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:11.410646 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-81c92ec4-2b2d-441c-b3b9-82a38798646b tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:11.419472 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-81c92ec4-2b2d-441c-b3b9-82a38798646b tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:11.420984 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-81c92ec4-2b2d-441c-b3b9-82a38798646b tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:11.421669 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-81c92ec4-2b2d-441c-b3b9-82a38798646b tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:11.423095 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-81c92ec4-2b2d-441c-b3b9-82a38798646b tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:11.423658 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-81c92ec4-2b2d-441c-b3b9-82a38798646b tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:11.424166 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-81c92ec4-2b2d-441c-b3b9-82a38798646b tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:11.518377 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-81c92ec4-2b2d-441c-b3b9-82a38798646b tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:11.526431 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-81c92ec4-2b2d-441c-b3b9-82a38798646b tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1267 microversion: 2.1 time: 0.121279 Sep 15 13:10:11.527352 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 488/962] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:11 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1267 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:10:11.916635 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Flavor limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:10:11.917201 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Image limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:10:11.917781 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Flavor pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:10:11.918289 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Image pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:10:11.919015 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:10:11.930173 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:11.930767 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:11.931273 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:11.932079 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:11.932655 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:11.933151 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:11.953623 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Getting quotas for project 9d04252e755e423eaf19e824f1c8c516. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:10:11.958224 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Getting quotas for user b4ce1e64fa924abeb7a1e5292a3ca96a and project 9d04252e755e423eaf19e824f1c8c516. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:10:11.971019 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Going to run 1 instances... {{(pid=120634) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:10:11.973436 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120634) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:10:12.025508 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-05d29481-5e52-4205-b29d-8c51cdc993e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008502 Sep 15 13:10:12.033181 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 475/963] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:10:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 13:10:12.037990 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f4ca7c2b-066c-4321-84e4-29a9e81f8688 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:12.038606 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f4ca7c2b-066c-4321-84e4-29a9e81f8688 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:12.103262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f4ca7c2b-066c-4321-84e4-29a9e81f8688 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:12.111525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f4ca7c2b-066c-4321-84e4-29a9e81f8688 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1218 microversion: 2.1 time: 0.077363 Sep 15 13:10:12.112099 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 489/964] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:12 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:12.551461 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-45a3f026-3d74-42c2-b35b-5de30ade3642 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:12.553826 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-45a3f026-3d74-42c2-b35b-5de30ade3642 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:12.561821 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-45a3f026-3d74-42c2-b35b-5de30ade3642 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:12.562483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-45a3f026-3d74-42c2-b35b-5de30ade3642 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:12.563020 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-45a3f026-3d74-42c2-b35b-5de30ade3642 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:12.564132 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-45a3f026-3d74-42c2-b35b-5de30ade3642 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:12.564841 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-45a3f026-3d74-42c2-b35b-5de30ade3642 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:12.565370 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-45a3f026-3d74-42c2-b35b-5de30ade3642 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:12.781583 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-45a3f026-3d74-42c2-b35b-5de30ade3642 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:12.791166 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-45a3f026-3d74-42c2-b35b-5de30ade3642 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1315 microversion: 2.1 time: 0.243572 Sep 15 13:10:12.792056 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 476/965] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:12 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:13.135095 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-24a86859-8c61-4562-b0b6-fdecd4c6ea38 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:13.137333 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-24a86859-8c61-4562-b0b6-fdecd4c6ea38 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:13.146420 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-24a86859-8c61-4562-b0b6-fdecd4c6ea38 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:13.147573 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-24a86859-8c61-4562-b0b6-fdecd4c6ea38 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:13.148453 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-24a86859-8c61-4562-b0b6-fdecd4c6ea38 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:13.149368 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-24a86859-8c61-4562-b0b6-fdecd4c6ea38 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:13.149899 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-24a86859-8c61-4562-b0b6-fdecd4c6ea38 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:13.150393 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-24a86859-8c61-4562-b0b6-fdecd4c6ea38 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:13.225956 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-24a86859-8c61-4562-b0b6-fdecd4c6ea38 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:13.235424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-24a86859-8c61-4562-b0b6-fdecd4c6ea38 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1270 microversion: 2.1 time: 0.104328 Sep 15 13:10:13.236588 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 490/966] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:13 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:13.608183 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-0b4048de-36a7-4a5f-a275-b1b0f440b35f req-22dff6a8-932a-4997-a6eb-738fd1c04a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad1caf52-bd42-42fd-8155-7ee2804fa6e5", "tag": "7c2c37d5-caa5-4a61-b53f-489a6a8d1e73"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:10:13.619489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-0b4048de-36a7-4a5f-a275-b1b0f440b35f req-22dff6a8-932a-4997-a6eb-738fd1c04a24 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:13.620065 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-0b4048de-36a7-4a5f-a275-b1b0f440b35f req-22dff6a8-932a-4997-a6eb-738fd1c04a24 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:13.620541 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-0b4048de-36a7-4a5f-a275-b1b0f440b35f req-22dff6a8-932a-4997-a6eb-738fd1c04a24 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:13.633307 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-0b4048de-36a7-4a5f-a275-b1b0f440b35f req-22dff6a8-932a-4997-a6eb-738fd1c04a24 service nova] Creating event network-changed:7c2c37d5-caa5-4a61-b53f-489a6a8d1e73 for instance ad1caf52-bd42-42fd-8155-7ee2804fa6e5 on hv-cinder-83608 Sep 15 13:10:13.638179 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-0b4048de-36a7-4a5f-a275-b1b0f440b35f req-22dff6a8-932a-4997-a6eb-738fd1c04a24 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035206 Sep 15 13:10:13.638855 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 477/967] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:10:13.815300 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4875de9b-9336-4884-9e64-7c2a533fa9b8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:13.815909 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-4875de9b-9336-4884-9e64-7c2a533fa9b8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:13.821811 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4875de9b-9336-4884-9e64-7c2a533fa9b8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:13.822299 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4875de9b-9336-4884-9e64-7c2a533fa9b8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:13.822734 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4875de9b-9336-4884-9e64-7c2a533fa9b8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:13.823424 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4875de9b-9336-4884-9e64-7c2a533fa9b8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:13.823877 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4875de9b-9336-4884-9e64-7c2a533fa9b8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:13.824320 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4875de9b-9336-4884-9e64-7c2a533fa9b8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:13.959219 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4875de9b-9336-4884-9e64-7c2a533fa9b8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:13.967662 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-4875de9b-9336-4884-9e64-7c2a533fa9b8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1315 microversion: 2.1 time: 0.155980 Sep 15 13:10:13.971428 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 491/968] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:13 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:14.258999 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-7b4f218e-790c-4d67-b231-78529f68e7a5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:14.259680 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-7b4f218e-790c-4d67-b231-78529f68e7a5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:14.266113 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7b4f218e-790c-4d67-b231-78529f68e7a5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:14.266594 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7b4f218e-790c-4d67-b231-78529f68e7a5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:14.267018 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7b4f218e-790c-4d67-b231-78529f68e7a5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:14.267703 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7b4f218e-790c-4d67-b231-78529f68e7a5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:14.268148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7b4f218e-790c-4d67-b231-78529f68e7a5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:14.268589 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7b4f218e-790c-4d67-b231-78529f68e7a5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:14.511152 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-7b4f218e-790c-4d67-b231-78529f68e7a5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:14.519343 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-7b4f218e-790c-4d67-b231-78529f68e7a5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1318 microversion: 2.1 time: 0.264496 Sep 15 13:10:14.519919 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 478/969] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:14 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:14.991051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a2ef3691-96cf-44ec-836b-b20e8da76ea3 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:14.991791 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a2ef3691-96cf-44ec-836b-b20e8da76ea3 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:14.998297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a2ef3691-96cf-44ec-836b-b20e8da76ea3 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:14.998788 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a2ef3691-96cf-44ec-836b-b20e8da76ea3 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:14.999226 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a2ef3691-96cf-44ec-836b-b20e8da76ea3 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:15.000533 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a2ef3691-96cf-44ec-836b-b20e8da76ea3 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:15.000991 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a2ef3691-96cf-44ec-836b-b20e8da76ea3 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:15.001412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a2ef3691-96cf-44ec-836b-b20e8da76ea3 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:15.135022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a2ef3691-96cf-44ec-836b-b20e8da76ea3 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:15.143086 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a2ef3691-96cf-44ec-836b-b20e8da76ea3 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1315 microversion: 2.1 time: 0.155880 Sep 15 13:10:15.143651 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 492/970] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:14 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:15.542930 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4735a069-db51-4155-b65d-09f50e4490f0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:15.543549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-4735a069-db51-4155-b65d-09f50e4490f0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:15.549978 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4735a069-db51-4155-b65d-09f50e4490f0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:15.550458 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4735a069-db51-4155-b65d-09f50e4490f0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:15.550892 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4735a069-db51-4155-b65d-09f50e4490f0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:15.551580 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4735a069-db51-4155-b65d-09f50e4490f0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:15.552033 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4735a069-db51-4155-b65d-09f50e4490f0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:15.552491 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4735a069-db51-4155-b65d-09f50e4490f0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:15.661923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-02c5aaf6-0307-47aa-844b-507bcca78751 req-285513dd-3fac-44a4-adaf-52135f1f937e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f", "tag": "e45a4356-1f3c-4ae5-a251-e800af83443e"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:10:15.671866 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-02c5aaf6-0307-47aa-844b-507bcca78751 req-285513dd-3fac-44a4-adaf-52135f1f937e service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:15.672365 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-02c5aaf6-0307-47aa-844b-507bcca78751 req-285513dd-3fac-44a4-adaf-52135f1f937e service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:15.672954 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-02c5aaf6-0307-47aa-844b-507bcca78751 req-285513dd-3fac-44a4-adaf-52135f1f937e service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:15.683679 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-02c5aaf6-0307-47aa-844b-507bcca78751 req-285513dd-3fac-44a4-adaf-52135f1f937e service nova] Creating event network-changed:e45a4356-1f3c-4ae5-a251-e800af83443e for instance d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f on hv-cinder-83608 Sep 15 13:10:15.688762 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-4735a069-db51-4155-b65d-09f50e4490f0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:15.688928 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-02c5aaf6-0307-47aa-844b-507bcca78751 req-285513dd-3fac-44a4-adaf-52135f1f937e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030561 Sep 15 13:10:15.689351 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 493/971] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:10:15.696608 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-4735a069-db51-4155-b65d-09f50e4490f0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1318 microversion: 2.1 time: 0.157537 Sep 15 13:10:15.697166 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 479/972] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:15 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:16.167743 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9dfc4d22-2712-4f19-8d2c-2d9d3c81da7f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:16.168614 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9dfc4d22-2712-4f19-8d2c-2d9d3c81da7f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:16.174904 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9dfc4d22-2712-4f19-8d2c-2d9d3c81da7f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:16.175383 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9dfc4d22-2712-4f19-8d2c-2d9d3c81da7f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:16.175818 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9dfc4d22-2712-4f19-8d2c-2d9d3c81da7f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:16.176529 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9dfc4d22-2712-4f19-8d2c-2d9d3c81da7f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:16.176980 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9dfc4d22-2712-4f19-8d2c-2d9d3c81da7f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:16.177400 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9dfc4d22-2712-4f19-8d2c-2d9d3c81da7f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:16.307933 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9dfc4d22-2712-4f19-8d2c-2d9d3c81da7f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:16.315857 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9dfc4d22-2712-4f19-8d2c-2d9d3c81da7f tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1315 microversion: 2.1 time: 0.152777 Sep 15 13:10:16.316437 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 494/973] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:16 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:16.719028 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-94030095-11e9-4461-9598-16ddaf022464 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:16.719884 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-94030095-11e9-4461-9598-16ddaf022464 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:16.726199 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-94030095-11e9-4461-9598-16ddaf022464 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:16.726683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-94030095-11e9-4461-9598-16ddaf022464 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:16.727111 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-94030095-11e9-4461-9598-16ddaf022464 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:16.727800 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-94030095-11e9-4461-9598-16ddaf022464 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:16.728246 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-94030095-11e9-4461-9598-16ddaf022464 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:16.728694 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-94030095-11e9-4461-9598-16ddaf022464 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:17.072120 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-94030095-11e9-4461-9598-16ddaf022464 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:17.080528 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-94030095-11e9-4461-9598-16ddaf022464 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1318 microversion: 2.1 time: 0.365394 Sep 15 13:10:17.081331 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 480/974] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:16 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:17.338956 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-21bbeb77-2b6f-43f9-a51a-b325b1bc2321 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:17.339570 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-21bbeb77-2b6f-43f9-a51a-b325b1bc2321 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:17.346744 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-21bbeb77-2b6f-43f9-a51a-b325b1bc2321 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:17.347228 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-21bbeb77-2b6f-43f9-a51a-b325b1bc2321 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:17.347696 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-21bbeb77-2b6f-43f9-a51a-b325b1bc2321 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:17.348436 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-21bbeb77-2b6f-43f9-a51a-b325b1bc2321 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:17.348899 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-21bbeb77-2b6f-43f9-a51a-b325b1bc2321 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:17.349349 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-21bbeb77-2b6f-43f9-a51a-b325b1bc2321 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:17.480029 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-21bbeb77-2b6f-43f9-a51a-b325b1bc2321 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:17.487824 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-21bbeb77-2b6f-43f9-a51a-b325b1bc2321 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1315 microversion: 2.1 time: 0.152729 Sep 15 13:10:17.488418 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 495/975] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:17 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:18.103054 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-85684db1-f67d-4c43-8705-8191b1e9afd1 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:18.103596 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-85684db1-f67d-4c43-8705-8191b1e9afd1 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:18.110644 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-85684db1-f67d-4c43-8705-8191b1e9afd1 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:18.111118 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-85684db1-f67d-4c43-8705-8191b1e9afd1 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:18.111547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-85684db1-f67d-4c43-8705-8191b1e9afd1 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:18.112227 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-85684db1-f67d-4c43-8705-8191b1e9afd1 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:18.112699 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-85684db1-f67d-4c43-8705-8191b1e9afd1 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:18.113113 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-85684db1-f67d-4c43-8705-8191b1e9afd1 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:18.242664 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-85684db1-f67d-4c43-8705-8191b1e9afd1 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:18.250281 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-85684db1-f67d-4c43-8705-8191b1e9afd1 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1318 microversion: 2.1 time: 0.151150 Sep 15 13:10:18.250840 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 481/976] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:18 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:18.511029 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9bc1106f-d6f1-4f71-9fb1-0db5bf85aa5d tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:18.511641 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9bc1106f-d6f1-4f71-9fb1-0db5bf85aa5d tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:18.518339 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9bc1106f-d6f1-4f71-9fb1-0db5bf85aa5d tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:18.518814 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9bc1106f-d6f1-4f71-9fb1-0db5bf85aa5d tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:18.519250 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9bc1106f-d6f1-4f71-9fb1-0db5bf85aa5d tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:18.519935 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9bc1106f-d6f1-4f71-9fb1-0db5bf85aa5d tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:18.520409 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9bc1106f-d6f1-4f71-9fb1-0db5bf85aa5d tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:18.520827 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9bc1106f-d6f1-4f71-9fb1-0db5bf85aa5d tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:18.652689 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9bc1106f-d6f1-4f71-9fb1-0db5bf85aa5d tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:18.660822 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9bc1106f-d6f1-4f71-9fb1-0db5bf85aa5d tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1315 microversion: 2.1 time: 0.153734 Sep 15 13:10:18.661389 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 496/977] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:18 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:19.272925 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-b2216430-3308-43a9-9a36-958fb94aed01 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:19.273540 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-b2216430-3308-43a9-9a36-958fb94aed01 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:19.279919 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b2216430-3308-43a9-9a36-958fb94aed01 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:19.280438 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b2216430-3308-43a9-9a36-958fb94aed01 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:19.280876 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b2216430-3308-43a9-9a36-958fb94aed01 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:19.282228 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b2216430-3308-43a9-9a36-958fb94aed01 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:19.282679 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b2216430-3308-43a9-9a36-958fb94aed01 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:19.283104 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-b2216430-3308-43a9-9a36-958fb94aed01 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:19.411359 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-b2216430-3308-43a9-9a36-958fb94aed01 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:19.418940 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-b2216430-3308-43a9-9a36-958fb94aed01 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1318 microversion: 2.1 time: 0.150149 Sep 15 13:10:19.419505 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 482/978] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:19 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:19.682837 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d726074c-3d36-43ae-8d4b-e44d3670bce0 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:19.683452 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d726074c-3d36-43ae-8d4b-e44d3670bce0 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:19.689991 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d726074c-3d36-43ae-8d4b-e44d3670bce0 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:19.690473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d726074c-3d36-43ae-8d4b-e44d3670bce0 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:19.690913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d726074c-3d36-43ae-8d4b-e44d3670bce0 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:19.691600 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d726074c-3d36-43ae-8d4b-e44d3670bce0 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:19.692054 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d726074c-3d36-43ae-8d4b-e44d3670bce0 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:19.692508 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d726074c-3d36-43ae-8d4b-e44d3670bce0 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:19.821656 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d726074c-3d36-43ae-8d4b-e44d3670bce0 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:19.830764 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d726074c-3d36-43ae-8d4b-e44d3670bce0 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1315 microversion: 2.1 time: 0.151770 Sep 15 13:10:19.831334 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 497/979] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:19 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:20.058974 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-986a43ae-3ff1-46ed-bd34-f462c4c0c133 req-85b86b1c-52aa-49c9-9d08-13b514d85aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1caf52-bd42-42fd-8155-7ee2804fa6e5", "name": "network-vif-plugged", "status": "completed", "tag": "7c2c37d5-caa5-4a61-b53f-489a6a8d1e73"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:10:20.069130 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-986a43ae-3ff1-46ed-bd34-f462c4c0c133 req-85b86b1c-52aa-49c9-9d08-13b514d85aa2 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:20.069611 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-986a43ae-3ff1-46ed-bd34-f462c4c0c133 req-85b86b1c-52aa-49c9-9d08-13b514d85aa2 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:20.070057 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-986a43ae-3ff1-46ed-bd34-f462c4c0c133 req-85b86b1c-52aa-49c9-9d08-13b514d85aa2 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:20.080967 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-986a43ae-3ff1-46ed-bd34-f462c4c0c133 req-85b86b1c-52aa-49c9-9d08-13b514d85aa2 service nova] Creating event network-vif-plugged:7c2c37d5-caa5-4a61-b53f-489a6a8d1e73 for instance ad1caf52-bd42-42fd-8155-7ee2804fa6e5 on hv-cinder-83608 Sep 15 13:10:20.086013 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-986a43ae-3ff1-46ed-bd34-f462c4c0c133 req-85b86b1c-52aa-49c9-9d08-13b514d85aa2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210763 Sep 15 13:10:20.086674 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 483/980] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:10:20.441684 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2145737c-017e-4f50-b497-c32e8d337208 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:20.442291 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2145737c-017e-4f50-b497-c32e8d337208 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:20.448232 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2145737c-017e-4f50-b497-c32e8d337208 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:20.448744 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2145737c-017e-4f50-b497-c32e8d337208 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:20.449174 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2145737c-017e-4f50-b497-c32e8d337208 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:20.449860 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2145737c-017e-4f50-b497-c32e8d337208 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:20.450306 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2145737c-017e-4f50-b497-c32e8d337208 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:20.450725 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2145737c-017e-4f50-b497-c32e8d337208 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:20.578734 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2145737c-017e-4f50-b497-c32e8d337208 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:20.586268 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2145737c-017e-4f50-b497-c32e8d337208 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1318 microversion: 2.1 time: 0.148474 Sep 15 13:10:20.586819 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 498/981] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:20 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:20.855174 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-76d8cfd8-5d88-4e77-b59e-e7b305a3d735 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:20.855877 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-76d8cfd8-5d88-4e77-b59e-e7b305a3d735 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:20.862395 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-76d8cfd8-5d88-4e77-b59e-e7b305a3d735 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:20.862878 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-76d8cfd8-5d88-4e77-b59e-e7b305a3d735 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:20.863308 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-76d8cfd8-5d88-4e77-b59e-e7b305a3d735 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:20.863993 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-76d8cfd8-5d88-4e77-b59e-e7b305a3d735 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:20.864473 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-76d8cfd8-5d88-4e77-b59e-e7b305a3d735 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:20.864896 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-76d8cfd8-5d88-4e77-b59e-e7b305a3d735 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:21.263115 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-76d8cfd8-5d88-4e77-b59e-e7b305a3d735 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:21.270933 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-76d8cfd8-5d88-4e77-b59e-e7b305a3d735 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1315 microversion: 2.1 time: 0.420478 Sep 15 13:10:21.271496 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 484/982] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:20 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:10:21.610691 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-eabd79f9-0a7f-45ba-9ea7-618e4fe3461d tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:21.611237 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-eabd79f9-0a7f-45ba-9ea7-618e4fe3461d tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:21.617681 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eabd79f9-0a7f-45ba-9ea7-618e4fe3461d tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:21.618163 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eabd79f9-0a7f-45ba-9ea7-618e4fe3461d tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:21.618591 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eabd79f9-0a7f-45ba-9ea7-618e4fe3461d tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:21.619278 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eabd79f9-0a7f-45ba-9ea7-618e4fe3461d tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:21.619726 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eabd79f9-0a7f-45ba-9ea7-618e4fe3461d tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:21.620143 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-eabd79f9-0a7f-45ba-9ea7-618e4fe3461d tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:21.753553 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-eabd79f9-0a7f-45ba-9ea7-618e4fe3461d tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:21.761213 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-eabd79f9-0a7f-45ba-9ea7-618e4fe3461d tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1318 microversion: 2.1 time: 0.155272 Sep 15 13:10:21.761786 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 499/983] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:21 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:22.293875 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fc32e55a-ebb3-4abb-aa24-c5e3da74a123 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:22.294488 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-fc32e55a-ebb3-4abb-aa24-c5e3da74a123 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:22.297432 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=4 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:22.298092 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=12 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:22.304007 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fc32e55a-ebb3-4abb-aa24-c5e3da74a123 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:22.304518 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fc32e55a-ebb3-4abb-aa24-c5e3da74a123 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:22.304964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fc32e55a-ebb3-4abb-aa24-c5e3da74a123 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:22.305663 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fc32e55a-ebb3-4abb-aa24-c5e3da74a123 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:22.306119 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fc32e55a-ebb3-4abb-aa24-c5e3da74a123 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:22.306545 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-fc32e55a-ebb3-4abb-aa24-c5e3da74a123 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:22.438446 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-fc32e55a-ebb3-4abb-aa24-c5e3da74a123 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:22.447279 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-fc32e55a-ebb3-4abb-aa24-c5e3da74a123 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1464 microversion: 2.1 time: 0.157232 Sep 15 13:10:22.447946 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 485/984] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:22 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1464 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:22.493794 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-93d24595-13ec-4a12-ad39-87a3afbf2cdf tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:22.494285 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-93d24595-13ec-4a12-ad39-87a3afbf2cdf tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:22.496198 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=4 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:22.501894 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-93d24595-13ec-4a12-ad39-87a3afbf2cdf tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:22.502377 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-93d24595-13ec-4a12-ad39-87a3afbf2cdf tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:22.502803 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-93d24595-13ec-4a12-ad39-87a3afbf2cdf tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:22.503486 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-93d24595-13ec-4a12-ad39-87a3afbf2cdf tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:22.503934 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-93d24595-13ec-4a12-ad39-87a3afbf2cdf tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:22.504379 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-93d24595-13ec-4a12-ad39-87a3afbf2cdf tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:22.530358 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-93d24595-13ec-4a12-ad39-87a3afbf2cdf tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Going to try to terminate instance {{(pid=120633) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:10:22.608501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-93d24595-13ec-4a12-ad39-87a3afbf2cdf tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 204 len: 0 microversion: 2.1 time: 0.118199 Sep 15 13:10:22.609247 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 500/985] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:10:22 2022] DELETE /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:10:22.617717 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c72b8362-300d-4287-8ba7-2b080f6e47a9 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:22.618389 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c72b8362-300d-4287-8ba7-2b080f6e47a9 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:22.624246 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c72b8362-300d-4287-8ba7-2b080f6e47a9 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:22.625271 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c72b8362-300d-4287-8ba7-2b080f6e47a9 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:22.625707 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c72b8362-300d-4287-8ba7-2b080f6e47a9 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:22.626556 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c72b8362-300d-4287-8ba7-2b080f6e47a9 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:22.627014 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c72b8362-300d-4287-8ba7-2b080f6e47a9 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:22.627438 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c72b8362-300d-4287-8ba7-2b080f6e47a9 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:22.757517 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-c72b8362-300d-4287-8ba7-2b080f6e47a9 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:22.765202 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c72b8362-300d-4287-8ba7-2b080f6e47a9 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1470 microversion: 2.1 time: 0.151357 Sep 15 13:10:22.766301 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 486/986] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:22 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:22.787430 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-50c00021-09ba-4ba9-a409-44b2d0cdb5fb tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:22.788140 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-50c00021-09ba-4ba9-a409-44b2d0cdb5fb tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:22.794526 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-50c00021-09ba-4ba9-a409-44b2d0cdb5fb tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:22.795010 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-50c00021-09ba-4ba9-a409-44b2d0cdb5fb tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:22.795445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-50c00021-09ba-4ba9-a409-44b2d0cdb5fb tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:22.796137 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-50c00021-09ba-4ba9-a409-44b2d0cdb5fb tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:22.797009 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-50c00021-09ba-4ba9-a409-44b2d0cdb5fb tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:22.797441 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-50c00021-09ba-4ba9-a409-44b2d0cdb5fb tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:22.926276 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-50c00021-09ba-4ba9-a409-44b2d0cdb5fb tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:22.933888 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-50c00021-09ba-4ba9-a409-44b2d0cdb5fb tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1318 microversion: 2.1 time: 0.150636 Sep 15 13:10:22.934616 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 501/987] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:22 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:23.789827 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-bcc0b008-f8aa-4a17-9232-a572fe0f5fb8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:23.790436 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-bcc0b008-f8aa-4a17-9232-a572fe0f5fb8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:23.796521 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bcc0b008-f8aa-4a17-9232-a572fe0f5fb8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:23.797013 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bcc0b008-f8aa-4a17-9232-a572fe0f5fb8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:23.797482 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bcc0b008-f8aa-4a17-9232-a572fe0f5fb8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:23.798232 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bcc0b008-f8aa-4a17-9232-a572fe0f5fb8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:23.798714 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bcc0b008-f8aa-4a17-9232-a572fe0f5fb8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:23.799136 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bcc0b008-f8aa-4a17-9232-a572fe0f5fb8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:23.902779 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-3c4e9478-8c30-4cc5-b3db-6a324f5ddd70 req-398855d6-aa55-4032-99ae-94b17f8c608d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f", "name": "network-vif-plugged", "status": "completed", "tag": "e45a4356-1f3c-4ae5-a251-e800af83443e"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:10:23.914637 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-3c4e9478-8c30-4cc5-b3db-6a324f5ddd70 req-398855d6-aa55-4032-99ae-94b17f8c608d service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:23.915270 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-3c4e9478-8c30-4cc5-b3db-6a324f5ddd70 req-398855d6-aa55-4032-99ae-94b17f8c608d service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:23.915765 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-3c4e9478-8c30-4cc5-b3db-6a324f5ddd70 req-398855d6-aa55-4032-99ae-94b17f8c608d service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:23.927532 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-3c4e9478-8c30-4cc5-b3db-6a324f5ddd70 req-398855d6-aa55-4032-99ae-94b17f8c608d service nova] Creating event network-vif-plugged:e45a4356-1f3c-4ae5-a251-e800af83443e for instance d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f on hv-cinder-83608 Sep 15 13:10:23.931293 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-bcc0b008-f8aa-4a17-9232-a572fe0f5fb8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:23.932937 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-3c4e9478-8c30-4cc5-b3db-6a324f5ddd70 req-398855d6-aa55-4032-99ae-94b17f8c608d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033771 Sep 15 13:10:23.933836 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 502/988] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:10:23.941199 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-bcc0b008-f8aa-4a17-9232-a572fe0f5fb8 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1470 microversion: 2.1 time: 0.155277 Sep 15 13:10:23.957692 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 487/989] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:23 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:23.958937 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-dd59f3cb-a465-413a-b166-35267d45f3e9 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:23.959654 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-dd59f3cb-a465-413a-b166-35267d45f3e9 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:23.966407 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dd59f3cb-a465-413a-b166-35267d45f3e9 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:23.966995 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dd59f3cb-a465-413a-b166-35267d45f3e9 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:23.967515 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dd59f3cb-a465-413a-b166-35267d45f3e9 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:23.968420 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dd59f3cb-a465-413a-b166-35267d45f3e9 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:23.969003 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dd59f3cb-a465-413a-b166-35267d45f3e9 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:23.969527 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dd59f3cb-a465-413a-b166-35267d45f3e9 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:24.104179 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-dd59f3cb-a465-413a-b166-35267d45f3e9 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:24.112212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-dd59f3cb-a465-413a-b166-35267d45f3e9 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1318 microversion: 2.1 time: 0.159752 Sep 15 13:10:24.112844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 503/990] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:23 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:24.830213 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-c4d34f13-8df0-4eae-b5ad-f5bd56ae4203 req-cddd6e7c-02a2-4747-b358-8dd966f06605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1caf52-bd42-42fd-8155-7ee2804fa6e5", "name": "network-vif-deleted", "tag": "7c2c37d5-caa5-4a61-b53f-489a6a8d1e73"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:10:24.841229 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-c4d34f13-8df0-4eae-b5ad-f5bd56ae4203 req-cddd6e7c-02a2-4747-b358-8dd966f06605 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:24.841897 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-c4d34f13-8df0-4eae-b5ad-f5bd56ae4203 req-cddd6e7c-02a2-4747-b358-8dd966f06605 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:24.842408 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-c4d34f13-8df0-4eae-b5ad-f5bd56ae4203 req-cddd6e7c-02a2-4747-b358-8dd966f06605 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:24.855988 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-c4d34f13-8df0-4eae-b5ad-f5bd56ae4203 req-cddd6e7c-02a2-4747-b358-8dd966f06605 service nova] Creating event network-vif-deleted:7c2c37d5-caa5-4a61-b53f-489a6a8d1e73 for instance ad1caf52-bd42-42fd-8155-7ee2804fa6e5 on hv-cinder-83608 Sep 15 13:10:24.861480 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-c4d34f13-8df0-4eae-b5ad-f5bd56ae4203 req-cddd6e7c-02a2-4747-b358-8dd966f06605 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035733 Sep 15 13:10:24.862133 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 488/991] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:10:24.965480 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4de7236e-1555-4601-aea4-88388eac9d84 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:24.966096 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-4de7236e-1555-4601-aea4-88388eac9d84 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:24.972701 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4de7236e-1555-4601-aea4-88388eac9d84 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:24.973191 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4de7236e-1555-4601-aea4-88388eac9d84 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:24.973620 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4de7236e-1555-4601-aea4-88388eac9d84 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:24.974309 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4de7236e-1555-4601-aea4-88388eac9d84 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:24.974771 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4de7236e-1555-4601-aea4-88388eac9d84 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:24.975194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-4de7236e-1555-4601-aea4-88388eac9d84 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:25.037188 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-4de7236e-1555-4601-aea4-88388eac9d84 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:25.044897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-4de7236e-1555-4601-aea4-88388eac9d84 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1300 microversion: 2.1 time: 0.083364 Sep 15 13:10:25.045461 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 504/992] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:24 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:25.135579 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2228982a-c084-4b03-8ea1-a382255172a0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:25.136201 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2228982a-c084-4b03-8ea1-a382255172a0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:25.142582 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2228982a-c084-4b03-8ea1-a382255172a0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:25.143058 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2228982a-c084-4b03-8ea1-a382255172a0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:25.143488 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2228982a-c084-4b03-8ea1-a382255172a0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:25.144168 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2228982a-c084-4b03-8ea1-a382255172a0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:25.144645 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2228982a-c084-4b03-8ea1-a382255172a0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:25.145061 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2228982a-c084-4b03-8ea1-a382255172a0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:25.275295 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2228982a-c084-4b03-8ea1-a382255172a0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:25.283364 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2228982a-c084-4b03-8ea1-a382255172a0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1318 microversion: 2.1 time: 0.152154 Sep 15 13:10:25.283924 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 489/993] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:25 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:26.068733 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cc7be8eb-c5a1-45c7-8a30-5c9395e5e2f7 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:26.069371 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cc7be8eb-c5a1-45c7-8a30-5c9395e5e2f7 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:26.075679 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7be8eb-c5a1-45c7-8a30-5c9395e5e2f7 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:26.076153 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7be8eb-c5a1-45c7-8a30-5c9395e5e2f7 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:26.076616 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7be8eb-c5a1-45c7-8a30-5c9395e5e2f7 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:26.077299 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7be8eb-c5a1-45c7-8a30-5c9395e5e2f7 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:26.078352 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7be8eb-c5a1-45c7-8a30-5c9395e5e2f7 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:26.079185 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7be8eb-c5a1-45c7-8a30-5c9395e5e2f7 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:26.083288 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:26.116635 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7be8eb-c5a1-45c7-8a30-5c9395e5e2f7 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:26.117128 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7be8eb-c5a1-45c7-8a30-5c9395e5e2f7 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:26.117565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc7be8eb-c5a1-45c7-8a30-5c9395e5e2f7 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:26.118014 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-cc7be8eb-c5a1-45c7-8a30-5c9395e5e2f7 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lazy-loading 'fault' on Instance uuid ad1caf52-bd42-42fd-8155-7ee2804fa6e5 {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:10:26.159073 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cc7be8eb-c5a1-45c7-8a30-5c9395e5e2f7 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e23717cb21e24f7cb23ec936b90ffd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec5f3334484051b6b6f4c0ee848e8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:26.166742 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cc7be8eb-c5a1-45c7-8a30-5c9395e5e2f7 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 200 len: 1305 microversion: 2.1 time: 0.102520 Sep 15 13:10:26.167308 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 505/994] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:26 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:26.306575 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-df1e4d47-542b-4a19-8934-652b64460f17 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:26.307247 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-df1e4d47-542b-4a19-8934-652b64460f17 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:26.314590 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df1e4d47-542b-4a19-8934-652b64460f17 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:26.315068 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df1e4d47-542b-4a19-8934-652b64460f17 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:26.315497 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df1e4d47-542b-4a19-8934-652b64460f17 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:26.316180 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df1e4d47-542b-4a19-8934-652b64460f17 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:26.316649 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df1e4d47-542b-4a19-8934-652b64460f17 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:26.317059 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df1e4d47-542b-4a19-8934-652b64460f17 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:26.445316 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-df1e4d47-542b-4a19-8934-652b64460f17 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:26.454589 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-df1e4d47-542b-4a19-8934-652b64460f17 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1507 microversion: 2.1 time: 0.151881 Sep 15 13:10:26.455156 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 490/995] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:26 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:27.190734 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bc92000f-921a-46fc-8f52-291a745f74c5 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:27.191348 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-bc92000f-921a-46fc-8f52-291a745f74c5 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] [instance: ad1caf52-bd42-42fd-8155-7ee2804fa6e5] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:27.197926 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bc92000f-921a-46fc-8f52-291a745f74c5 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:27.198400 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bc92000f-921a-46fc-8f52-291a745f74c5 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:27.198836 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bc92000f-921a-46fc-8f52-291a745f74c5 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:27.199644 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bc92000f-921a-46fc-8f52-291a745f74c5 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:27.200264 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bc92000f-921a-46fc-8f52-291a745f74c5 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:27.200712 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-bc92000f-921a-46fc-8f52-291a745f74c5 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:27.216937 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-bc92000f-921a-46fc-8f52-291a745f74c5 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] HTTP exception thrown: Instance ad1caf52-bd42-42fd-8155-7ee2804fa6e5 could not be found. Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bc92000f-921a-46fc-8f52-291a745f74c5 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Request method failure captured: Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 HTTP/1.1 Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyQwifu6dwbhOlLJc9HZKfA6nCkJscdQMLZpXhrZ4Ca58lLFjrYTa5_UWz-MLfGa-6OKskguI0n7JWELXZbVYLkJDluAShUKTruphlVY0-7v7AmS49_RS9x1qyh5sjvANZywikT3sD0FOUXwASOnnHa-m_5IRKGarVnTNePp-OPyZK8 Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 8bec5f3334484051b6b6f4c0ee848e8f Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-VolumesNegativeTest-1182147185 Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:10:27.218525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:10:27.220017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8bec5f3334484051b6b6f4c0ee848e8f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8bec5f3334484051b6b6f4c0ee848e8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8bec5f3334484051b6b6f4c0ee848e8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8bec5f3334484051b6b6f4c0ee848e8f"}]}] Sep 15 13:10:27.220017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-VolumesNegativeTest-1182147185 Sep 15 13:10:27.220017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 8bec5f3334484051b6b6f4c0ee848e8f Sep 15 13:10:27.220017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-VolumesNegativeTest-1182147185 Sep 15 13:10:27.220017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-VolumesNegativeTest-1182147185-project Sep 15 13:10:27.220017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:10:27.220017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:10:27.220017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: e23717cb21e24f7cb23ec936b90ffd42 Sep 15 13:10:27.220017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-VolumesNegativeTest-1182147185-project Sep 15 13:10:27.220017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:10:27.220017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance ad1caf52-bd42-42fd-8155-7ee2804fa6e5 could not be found. Sep 15 13:10:27.220017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': 'ad1caf52-bd42-42fd-8155-7ee2804fa6e5'} Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad1caf52-bd42-42fd-8155-7ee2804fa6e5 could not be found. Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:10:27.220902 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad1caf52-bd42-42fd-8155-7ee2804fa6e5 could not be found. Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad1caf52-bd42-42fd-8155-7ee2804fa6e5 could not be found. Sep 15 13:10:27.222314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:10:27.223882 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bc92000f-921a-46fc-8f52-291a745f74c5 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] Returning 404 to user: Instance ad1caf52-bd42-42fd-8155-7ee2804fa6e5 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:10:27.223882 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-bc92000f-921a-46fc-8f52-291a745f74c5 tempest-VolumesNegativeTest-1182147185 tempest-VolumesNegativeTest-1182147185-project] 10.222.0.57 "GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5" status: 404 len: 111 microversion: 2.1 time: 0.033739 Sep 15 13:10:27.223882 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 506/996] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:27 2022] GET /compute/v2.1/servers/ad1caf52-bd42-42fd-8155-7ee2804fa6e5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:10:32.680173 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6517a356-84d1-493c-85dd-7db74e8205e8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:10:32.682435 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6517a356-84d1-493c-85dd-7db74e8205e8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:32.689720 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6517a356-84d1-493c-85dd-7db74e8205e8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:32.690479 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6517a356-84d1-493c-85dd-7db74e8205e8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:32.691015 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6517a356-84d1-493c-85dd-7db74e8205e8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:32.691877 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6517a356-84d1-493c-85dd-7db74e8205e8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:32.692476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6517a356-84d1-493c-85dd-7db74e8205e8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:32.693015 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6517a356-84d1-493c-85dd-7db74e8205e8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:32.777890 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6517a356-84d1-493c-85dd-7db74e8205e8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "POST /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/action" status: 202 len: 0 microversion: 2.1 time: 0.101685 Sep 15 13:10:32.778852 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 491/997] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Sep 15 13:10:32 2022] POST /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:10:32.786953 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-106f25a7-b035-4574-902a-edc8d0b41556 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:32.787562 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-106f25a7-b035-4574-902a-edc8d0b41556 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:32.794040 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-106f25a7-b035-4574-902a-edc8d0b41556 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:32.794634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-106f25a7-b035-4574-902a-edc8d0b41556 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:32.795114 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-106f25a7-b035-4574-902a-edc8d0b41556 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:32.795806 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-106f25a7-b035-4574-902a-edc8d0b41556 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:32.796251 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-106f25a7-b035-4574-902a-edc8d0b41556 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:32.796768 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-106f25a7-b035-4574-902a-edc8d0b41556 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:32.955916 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-106f25a7-b035-4574-902a-edc8d0b41556 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:32.966662 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-106f25a7-b035-4574-902a-edc8d0b41556 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1751 microversion: 2.1 time: 0.183658 Sep 15 13:10:32.967238 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 507/998] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:32 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:33.996748 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-be4217b7-9036-4ba4-aa97-a18730b07966 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:33.997458 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-be4217b7-9036-4ba4-aa97-a18730b07966 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:34.011836 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-be4217b7-9036-4ba4-aa97-a18730b07966 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:34.012562 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-be4217b7-9036-4ba4-aa97-a18730b07966 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:34.013012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-be4217b7-9036-4ba4-aa97-a18730b07966 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:34.014951 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-be4217b7-9036-4ba4-aa97-a18730b07966 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:34.015566 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-be4217b7-9036-4ba4-aa97-a18730b07966 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:34.017435 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-be4217b7-9036-4ba4-aa97-a18730b07966 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:34.183753 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-be4217b7-9036-4ba4-aa97-a18730b07966 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:34.187303 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:34.193221 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-be4217b7-9036-4ba4-aa97-a18730b07966 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1756 microversion: 2.1 time: 0.201359 Sep 15 13:10:34.193798 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 492/999] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:33 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:35.218528 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-982d7316-a6b5-4e49-8504-baf4ada26024 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:35.219234 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-982d7316-a6b5-4e49-8504-baf4ada26024 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:35.228771 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-982d7316-a6b5-4e49-8504-baf4ada26024 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:35.232868 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-982d7316-a6b5-4e49-8504-baf4ada26024 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:35.233518 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-982d7316-a6b5-4e49-8504-baf4ada26024 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:35.234260 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-982d7316-a6b5-4e49-8504-baf4ada26024 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:35.234716 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-982d7316-a6b5-4e49-8504-baf4ada26024 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:35.235131 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-982d7316-a6b5-4e49-8504-baf4ada26024 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:35.464787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-982d7316-a6b5-4e49-8504-baf4ada26024 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:35.473786 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-982d7316-a6b5-4e49-8504-baf4ada26024 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1756 microversion: 2.1 time: 0.259045 Sep 15 13:10:35.474657 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 508/1000] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:35 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1756 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:36.498064 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0b708a3b-45ab-47e7-8c49-5e693dd7c1e6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:36.498853 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0b708a3b-45ab-47e7-8c49-5e693dd7c1e6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:36.508563 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0b708a3b-45ab-47e7-8c49-5e693dd7c1e6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:36.509107 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0b708a3b-45ab-47e7-8c49-5e693dd7c1e6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:36.509862 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0b708a3b-45ab-47e7-8c49-5e693dd7c1e6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:36.510524 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0b708a3b-45ab-47e7-8c49-5e693dd7c1e6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:36.511079 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0b708a3b-45ab-47e7-8c49-5e693dd7c1e6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:36.511400 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0b708a3b-45ab-47e7-8c49-5e693dd7c1e6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:36.682468 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0b708a3b-45ab-47e7-8c49-5e693dd7c1e6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:36.694625 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0b708a3b-45ab-47e7-8c49-5e693dd7c1e6 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1756 microversion: 2.1 time: 0.200352 Sep 15 13:10:36.695360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 493/1001] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:36 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:37.719475 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-095b884a-ce7a-4d6c-8094-6614b3da9b7b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:37.721451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-095b884a-ce7a-4d6c-8094-6614b3da9b7b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:37.728704 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-095b884a-ce7a-4d6c-8094-6614b3da9b7b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:37.729455 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-095b884a-ce7a-4d6c-8094-6614b3da9b7b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:37.730059 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-095b884a-ce7a-4d6c-8094-6614b3da9b7b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:37.730927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-095b884a-ce7a-4d6c-8094-6614b3da9b7b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:37.731677 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-095b884a-ce7a-4d6c-8094-6614b3da9b7b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:37.732886 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-095b884a-ce7a-4d6c-8094-6614b3da9b7b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:37.951122 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-095b884a-ce7a-4d6c-8094-6614b3da9b7b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:37.965813 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-095b884a-ce7a-4d6c-8094-6614b3da9b7b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1756 microversion: 2.1 time: 0.249503 Sep 15 13:10:37.979484 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 509/1002] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:37 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1756 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:38.991855 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4a9a2156-1b44-42fd-bdbc-09d76fda1dd2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:38.992709 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-4a9a2156-1b44-42fd-bdbc-09d76fda1dd2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:39.000333 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a9a2156-1b44-42fd-bdbc-09d76fda1dd2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:39.001690 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a9a2156-1b44-42fd-bdbc-09d76fda1dd2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:39.002260 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a9a2156-1b44-42fd-bdbc-09d76fda1dd2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:39.002999 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a9a2156-1b44-42fd-bdbc-09d76fda1dd2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:39.004009 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a9a2156-1b44-42fd-bdbc-09d76fda1dd2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:39.005106 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4a9a2156-1b44-42fd-bdbc-09d76fda1dd2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:39.179796 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-4a9a2156-1b44-42fd-bdbc-09d76fda1dd2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:39.188483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-4a9a2156-1b44-42fd-bdbc-09d76fda1dd2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1756 microversion: 2.1 time: 0.200574 Sep 15 13:10:39.189620 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 494/1003] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:38 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:40.219144 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cfc1a478-c3a0-4c57-8e60-b5c08b49c342 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:40.221024 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cfc1a478-c3a0-4c57-8e60-b5c08b49c342 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:40.237431 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cfc1a478-c3a0-4c57-8e60-b5c08b49c342 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:40.238278 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cfc1a478-c3a0-4c57-8e60-b5c08b49c342 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:40.239882 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cfc1a478-c3a0-4c57-8e60-b5c08b49c342 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:40.241714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cfc1a478-c3a0-4c57-8e60-b5c08b49c342 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:40.242791 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cfc1a478-c3a0-4c57-8e60-b5c08b49c342 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:40.252643 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cfc1a478-c3a0-4c57-8e60-b5c08b49c342 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:40.516862 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cfc1a478-c3a0-4c57-8e60-b5c08b49c342 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:40.531112 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cfc1a478-c3a0-4c57-8e60-b5c08b49c342 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1756 microversion: 2.1 time: 0.321414 Sep 15 13:10:40.531981 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 510/1004] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:40 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1756 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:41.556833 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-24d0149b-4950-45af-8115-9181d927f5ee tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:41.557474 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-24d0149b-4950-45af-8115-9181d927f5ee tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:41.564407 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:41.572672 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-24d0149b-4950-45af-8115-9181d927f5ee tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:41.573760 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-24d0149b-4950-45af-8115-9181d927f5ee tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:41.573760 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-24d0149b-4950-45af-8115-9181d927f5ee tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:41.574452 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-24d0149b-4950-45af-8115-9181d927f5ee tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:41.574911 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-24d0149b-4950-45af-8115-9181d927f5ee tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:41.575396 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-24d0149b-4950-45af-8115-9181d927f5ee tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:41.790113 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-24d0149b-4950-45af-8115-9181d927f5ee tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:41.809813 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-24d0149b-4950-45af-8115-9181d927f5ee tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1756 microversion: 2.1 time: 0.258328 Sep 15 13:10:41.810404 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 495/1005] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:41 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1756 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:42.314952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-fc8f2557-2745-4747-bcce-0bbac6d666ce tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Action: 'create', calling method: .version_select at 0x7f62c54a2430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-637497301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrICD7ZFlN3nSMRfl2233LkQaVGO8qUKOsijuEckMOjcUazYZX87r7hARi5sw9PyBO5jB0AbSz83KzinUU/hpEeAPZ7/UCh0UZ/FAn0VKMxMS/FHj/fU+EP3e+I0/ADTA=="}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:10:42.320412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:42.337476 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-fc8f2557-2745-4747-bcce-0bbac6d666ce tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Getting quotas for project 1344373f29a44b7c8db2f9bab5f38467. Resources: {'key_pairs'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:10:42.341608 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-fc8f2557-2745-4747-bcce-0bbac6d666ce tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Getting quotas for user 3c50430b23404745ab4c1099bf12d4f5 and project 1344373f29a44b7c8db2f9bab5f38467. Resources: {'key_pairs'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:10:42.366098 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-fc8f2557-2745-4747-bcce-0bbac6d666ce tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.240712 Sep 15 13:10:42.366703 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 511/1006] 10.222.0.57 () {60 vars in 1159 bytes} [Thu Sep 15 13:10:42 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:10:42.835630 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5f2328b4-d9f8-4252-8358-393d41b3d5b5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:42.836160 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5f2328b4-d9f8-4252-8358-393d41b3d5b5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:42.842648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5f2328b4-d9f8-4252-8358-393d41b3d5b5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:42.843138 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5f2328b4-d9f8-4252-8358-393d41b3d5b5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:42.843573 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5f2328b4-d9f8-4252-8358-393d41b3d5b5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:42.844306 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5f2328b4-d9f8-4252-8358-393d41b3d5b5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:42.845647 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5f2328b4-d9f8-4252-8358-393d41b3d5b5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:42.845647 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5f2328b4-d9f8-4252-8358-393d41b3d5b5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:43.023866 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5f2328b4-d9f8-4252-8358-393d41b3d5b5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:43.035689 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5f2328b4-d9f8-4252-8358-393d41b3d5b5 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1756 microversion: 2.1 time: 0.204514 Sep 15 13:10:43.036428 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 496/1007] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:42 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:10:44.059391 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7d96cea9-b20b-471b-b555-53d8bc0efa31 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:44.060005 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7d96cea9-b20b-471b-b555-53d8bc0efa31 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:44.067759 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7d96cea9-b20b-471b-b555-53d8bc0efa31 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:44.068243 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7d96cea9-b20b-471b-b555-53d8bc0efa31 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:44.068706 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7d96cea9-b20b-471b-b555-53d8bc0efa31 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:44.069395 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7d96cea9-b20b-471b-b555-53d8bc0efa31 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:44.069844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7d96cea9-b20b-471b-b555-53d8bc0efa31 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:44.070259 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7d96cea9-b20b-471b-b555-53d8bc0efa31 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:44.233352 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7d96cea9-b20b-471b-b555-53d8bc0efa31 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:44.243470 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7d96cea9-b20b-471b-b555-53d8bc0efa31 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1756 microversion: 2.1 time: 0.188290 Sep 15 13:10:44.244213 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 512/1008] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:44 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:45.268617 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-89e51154-1728-40a0-a063-9113c31e0176 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:45.269238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-89e51154-1728-40a0-a063-9113c31e0176 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:45.275837 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89e51154-1728-40a0-a063-9113c31e0176 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:45.276343 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89e51154-1728-40a0-a063-9113c31e0176 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:45.276780 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89e51154-1728-40a0-a063-9113c31e0176 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:45.277466 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89e51154-1728-40a0-a063-9113c31e0176 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:45.277911 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89e51154-1728-40a0-a063-9113c31e0176 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:45.278328 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-89e51154-1728-40a0-a063-9113c31e0176 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:45.462451 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-89e51154-1728-40a0-a063-9113c31e0176 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:45.471313 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-89e51154-1728-40a0-a063-9113c31e0176 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1756 microversion: 2.1 time: 0.207326 Sep 15 13:10:45.472674 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 497/1009] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:45 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1756 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:46.496233 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-aab0ce65-6d9c-4df8-85e6-d4b0f1b6cb55 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:46.496881 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-aab0ce65-6d9c-4df8-85e6-d4b0f1b6cb55 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:46.504168 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aab0ce65-6d9c-4df8-85e6-d4b0f1b6cb55 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:46.504683 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aab0ce65-6d9c-4df8-85e6-d4b0f1b6cb55 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:46.505119 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aab0ce65-6d9c-4df8-85e6-d4b0f1b6cb55 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:46.505817 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aab0ce65-6d9c-4df8-85e6-d4b0f1b6cb55 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:46.506273 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aab0ce65-6d9c-4df8-85e6-d4b0f1b6cb55 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:46.506691 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-aab0ce65-6d9c-4df8-85e6-d4b0f1b6cb55 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:46.651186 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-aab0ce65-6d9c-4df8-85e6-d4b0f1b6cb55 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:46.659705 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-aab0ce65-6d9c-4df8-85e6-d4b0f1b6cb55 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1756 microversion: 2.1 time: 0.167652 Sep 15 13:10:46.660306 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 513/1010] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:46 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:47.683996 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0b53ba49-09ca-483e-96ad-4da7f200b003 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:47.684579 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0b53ba49-09ca-483e-96ad-4da7f200b003 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:47.691231 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0b53ba49-09ca-483e-96ad-4da7f200b003 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:47.691719 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0b53ba49-09ca-483e-96ad-4da7f200b003 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:47.692207 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0b53ba49-09ca-483e-96ad-4da7f200b003 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:47.692915 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0b53ba49-09ca-483e-96ad-4da7f200b003 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:47.693366 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0b53ba49-09ca-483e-96ad-4da7f200b003 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:47.693790 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0b53ba49-09ca-483e-96ad-4da7f200b003 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:47.840786 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0b53ba49-09ca-483e-96ad-4da7f200b003 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:47.852678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0b53ba49-09ca-483e-96ad-4da7f200b003 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1756 microversion: 2.1 time: 0.172342 Sep 15 13:10:47.853257 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 498/1011] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:47 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:48.238742 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ed80f427-9d41-4eee-8516-19f5363855af tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "100b574b-d3ef-4406-93fd-971416be8814", "device": "/dev/sdb"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:10:48.242195 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ed80f427-9d41-4eee-8516-19f5363855af tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:48.249784 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ed80f427-9d41-4eee-8516-19f5363855af tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:48.250268 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ed80f427-9d41-4eee-8516-19f5363855af tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:48.251498 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ed80f427-9d41-4eee-8516-19f5363855af tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:48.252421 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ed80f427-9d41-4eee-8516-19f5363855af tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:48.252881 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ed80f427-9d41-4eee-8516-19f5363855af tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:48.253295 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ed80f427-9d41-4eee-8516-19f5363855af tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:48.569792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ed80f427-9d41-4eee-8516-19f5363855af tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "POST /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335747 Sep 15 13:10:48.578985 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 514/1012] 10.222.0.57 () {60 vars in 1323 bytes} [Thu Sep 15 13:10:48 2022] POST /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:10:48.878243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-cb120ce6-3416-4e9f-ac9c-e87895131f5b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:48.878836 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-cb120ce6-3416-4e9f-ac9c-e87895131f5b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:48.885448 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cb120ce6-3416-4e9f-ac9c-e87895131f5b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:48.885964 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cb120ce6-3416-4e9f-ac9c-e87895131f5b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:48.886390 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cb120ce6-3416-4e9f-ac9c-e87895131f5b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:48.887072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cb120ce6-3416-4e9f-ac9c-e87895131f5b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:48.887515 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cb120ce6-3416-4e9f-ac9c-e87895131f5b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:48.887932 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cb120ce6-3416-4e9f-ac9c-e87895131f5b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:49.040681 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-cb120ce6-3416-4e9f-ac9c-e87895131f5b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:49.051543 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-cb120ce6-3416-4e9f-ac9c-e87895131f5b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1756 microversion: 2.1 time: 0.177228 Sep 15 13:10:49.052555 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 499/1013] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:48 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:10:50.076029 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f4116115-9e5c-489f-adf5-39d1b17e9748 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:10:50.076929 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f4116115-9e5c-489f-adf5-39d1b17e9748 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:10:50.085514 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f4116115-9e5c-489f-adf5-39d1b17e9748 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:50.086054 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f4116115-9e5c-489f-adf5-39d1b17e9748 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:50.086492 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f4116115-9e5c-489f-adf5-39d1b17e9748 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:50.087218 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f4116115-9e5c-489f-adf5-39d1b17e9748 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:10:50.087665 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f4116115-9e5c-489f-adf5-39d1b17e9748 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:10:50.088083 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f4116115-9e5c-489f-adf5-39d1b17e9748 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:10:50.243501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f4116115-9e5c-489f-adf5-39d1b17e9748 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:10:50.253738 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f4116115-9e5c-489f-adf5-39d1b17e9748 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1759 microversion: 2.1 time: 0.182073 Sep 15 13:10:50.254334 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 515/1014] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:10:50 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:18.710688 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-455498671", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-637497301", "security_groups": [{"name": "tempest-secgroup-smoke-1018743802"}], "block_device_mapping_v2": [{"uuid": "0e102f8f-6323-4f91-9bad-e448eda6e544", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "557bdd31-96bd-482d-9ed9-43fcea7b78d7"}]}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:11:18.722561 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=9 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:18.723226 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=42 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:18.826475 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.network.neutron [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] validate_networks() for [('557bdd31-96bd-482d-9ed9-43fcea7b78d7', None, None, None, None, None)] {{(pid=120634) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:11:19.460242 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Flavor limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:11:19.460698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Image limits 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:11:19.461194 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Flavor pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:11:19.461627 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Image pref 0:0:0 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:11:19.462025 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.virt.hardware [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120634) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:11:19.470701 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:19.471768 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:19.472204 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:19.473012 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:19.473454 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:19.473876 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:19.490932 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Getting quotas for project 1344373f29a44b7c8db2f9bab5f38467. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:11:19.495144 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.quota [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Getting quotas for user 3c50430b23404745ab4c1099bf12d4f5 and project 1344373f29a44b7c8db2f9bab5f38467. Resources: {'cores', 'ram', 'instances'} {{(pid=120634) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:11:19.562480 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Going to run 1 instances... {{(pid=120634) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:11:19.564624 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e102f8f-6323-4f91-9bad-e448eda6e544',volume_size=None,volume_type=None)] {{(pid=120634) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:11:19.690863 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1a812d26-1e0f-43d5-8836-9410dcf8965a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.983963 Sep 15 13:11:19.691436 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 500/1015] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:11:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 13:11:19.702663 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a2044613-a019-4610-a37b-2e306d58c531 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:19.703240 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a2044613-a019-4610-a37b-2e306d58c531 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:19.706508 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=4 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:19.707409 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:19.708034 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:19.767616 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a2044613-a019-4610-a37b-2e306d58c531 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:19.776210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a2044613-a019-4610-a37b-2e306d58c531 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1093 microversion: 2.1 time: 0.077442 Sep 15 13:11:19.777602 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 516/1016] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:19 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:20.562034 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-7ec7a687-d1b8-4bc9-b3f7-37c22be9917c tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:20.562547 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-7ec7a687-d1b8-4bc9-b3f7-37c22be9917c tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:20.570112 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7ec7a687-d1b8-4bc9-b3f7-37c22be9917c tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:20.570586 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7ec7a687-d1b8-4bc9-b3f7-37c22be9917c tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:20.571014 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7ec7a687-d1b8-4bc9-b3f7-37c22be9917c tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:20.571691 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7ec7a687-d1b8-4bc9-b3f7-37c22be9917c tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:20.572137 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7ec7a687-d1b8-4bc9-b3f7-37c22be9917c tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:20.572584 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7ec7a687-d1b8-4bc9-b3f7-37c22be9917c tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:20.653232 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-7ec7a687-d1b8-4bc9-b3f7-37c22be9917c tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lazy-loading 'services' on Instance uuid d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:11:20.725392 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-7ec7a687-d1b8-4bc9-b3f7-37c22be9917c tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f/os-volume_attachments/100b574b-d3ef-4406-93fd-971416be8814" status: 202 len: 0 microversion: 2.1 time: 0.167595 Sep 15 13:11:20.726034 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 501/1017] 10.222.0.57 () {58 vars in 1416 bytes} [Thu Sep 15 13:11:20 2022] DELETE /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f/os-volume_attachments/100b574b-d3ef-4406-93fd-971416be8814 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:11:20.800898 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-23b31111-39c9-4147-830a-4c3ba61cd969 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:20.801533 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-23b31111-39c9-4147-830a-4c3ba61cd969 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:20.808225 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-23b31111-39c9-4147-830a-4c3ba61cd969 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:20.808811 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-23b31111-39c9-4147-830a-4c3ba61cd969 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:20.809246 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-23b31111-39c9-4147-830a-4c3ba61cd969 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:20.809943 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-23b31111-39c9-4147-830a-4c3ba61cd969 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:20.810396 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-23b31111-39c9-4147-830a-4c3ba61cd969 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:20.810845 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-23b31111-39c9-4147-830a-4c3ba61cd969 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:20.884376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-23b31111-39c9-4147-830a-4c3ba61cd969 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:20.892645 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-23b31111-39c9-4147-830a-4c3ba61cd969 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1199 microversion: 2.1 time: 0.095873 Sep 15 13:11:20.894320 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 517/1018] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:20 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1199 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:11:21.858450 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-18854a41-09e8-4565-bfbc-093700968398 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:21.859171 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-18854a41-09e8-4565-bfbc-093700968398 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:21.869262 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-18854a41-09e8-4565-bfbc-093700968398 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:21.869836 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-18854a41-09e8-4565-bfbc-093700968398 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:21.870344 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-18854a41-09e8-4565-bfbc-093700968398 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:21.871137 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-18854a41-09e8-4565-bfbc-093700968398 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:21.871803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-18854a41-09e8-4565-bfbc-093700968398 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:21.874529 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-18854a41-09e8-4565-bfbc-093700968398 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:21.903319 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-18854a41-09e8-4565-bfbc-093700968398 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Going to try to terminate instance {{(pid=120634) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:11:21.918304 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-25ad63a9-5c8c-4245-8c57-dacf2bd903d0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:21.920583 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-25ad63a9-5c8c-4245-8c57-dacf2bd903d0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:21.931461 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-25ad63a9-5c8c-4245-8c57-dacf2bd903d0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:21.931951 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-25ad63a9-5c8c-4245-8c57-dacf2bd903d0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:21.932602 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-25ad63a9-5c8c-4245-8c57-dacf2bd903d0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:21.933309 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-25ad63a9-5c8c-4245-8c57-dacf2bd903d0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:21.933762 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-25ad63a9-5c8c-4245-8c57-dacf2bd903d0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:21.934942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-25ad63a9-5c8c-4245-8c57-dacf2bd903d0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:22.022891 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-18854a41-09e8-4565-bfbc-093700968398 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 204 len: 0 microversion: 2.1 time: 0.169676 Sep 15 13:11:22.023642 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 502/1019] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:11:21 2022] DELETE /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 13:11:22.036497 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-69ba88d1-d356-4698-9b2d-fc9abd2a1852 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:22.037327 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-69ba88d1-d356-4698-9b2d-fc9abd2a1852 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:22.045199 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69ba88d1-d356-4698-9b2d-fc9abd2a1852 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:22.045679 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69ba88d1-d356-4698-9b2d-fc9abd2a1852 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:22.046133 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69ba88d1-d356-4698-9b2d-fc9abd2a1852 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:22.046801 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69ba88d1-d356-4698-9b2d-fc9abd2a1852 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:22.047249 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69ba88d1-d356-4698-9b2d-fc9abd2a1852 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:22.047663 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69ba88d1-d356-4698-9b2d-fc9abd2a1852 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:22.098271 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-25ad63a9-5c8c-4245-8c57-dacf2bd903d0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:22.106480 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-25ad63a9-5c8c-4245-8c57-dacf2bd903d0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1277 microversion: 2.1 time: 0.193110 Sep 15 13:11:22.107156 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 518/1020] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:21 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:22.316073 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-69ba88d1-d356-4698-9b2d-fc9abd2a1852 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:22.323863 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-69ba88d1-d356-4698-9b2d-fc9abd2a1852 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1513 microversion: 2.1 time: 0.295656 Sep 15 13:11:22.324476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 503/1021] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:22 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1513 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:22.706167 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-f104c8cc-a952-4cad-b77d-9e8bf89107bf req-72e65997-dc39-4f4e-a36c-d6298869da3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1f2714f-b4cf-431b-b172-22bb4feb5e27", "tag": "93e2cbdf-d2a6-4d91-93d8-dead8f9bc2b6"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:11:22.715970 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-f104c8cc-a952-4cad-b77d-9e8bf89107bf req-72e65997-dc39-4f4e-a36c-d6298869da3f service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:22.716491 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-f104c8cc-a952-4cad-b77d-9e8bf89107bf req-72e65997-dc39-4f4e-a36c-d6298869da3f service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:22.716976 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-f104c8cc-a952-4cad-b77d-9e8bf89107bf req-72e65997-dc39-4f4e-a36c-d6298869da3f service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:22.728237 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-f104c8cc-a952-4cad-b77d-9e8bf89107bf req-72e65997-dc39-4f4e-a36c-d6298869da3f service nova] Creating event network-changed:93e2cbdf-d2a6-4d91-93d8-dead8f9bc2b6 for instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 on hv-cinder-83608 Sep 15 13:11:22.733191 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-f104c8cc-a952-4cad-b77d-9e8bf89107bf req-72e65997-dc39-4f4e-a36c-d6298869da3f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031370 Sep 15 13:11:22.733782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 519/1022] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:11:23.131017 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a0d3ff50-2ffe-4bc8-8ea8-498643cb2e80 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:23.131634 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a0d3ff50-2ffe-4bc8-8ea8-498643cb2e80 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:23.137995 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0d3ff50-2ffe-4bc8-8ea8-498643cb2e80 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:23.138477 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0d3ff50-2ffe-4bc8-8ea8-498643cb2e80 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:23.138914 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0d3ff50-2ffe-4bc8-8ea8-498643cb2e80 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:23.139598 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0d3ff50-2ffe-4bc8-8ea8-498643cb2e80 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:23.140048 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0d3ff50-2ffe-4bc8-8ea8-498643cb2e80 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:23.140493 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0d3ff50-2ffe-4bc8-8ea8-498643cb2e80 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:23.272639 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a0d3ff50-2ffe-4bc8-8ea8-498643cb2e80 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:23.280227 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a0d3ff50-2ffe-4bc8-8ea8-498643cb2e80 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1277 microversion: 2.1 time: 0.153635 Sep 15 13:11:23.280825 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 504/1023] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:23 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:23.349393 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-470ef6de-5cc0-4e2c-ad49-74d04b6ac862 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:23.350036 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-470ef6de-5cc0-4e2c-ad49-74d04b6ac862 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:23.358201 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-470ef6de-5cc0-4e2c-ad49-74d04b6ac862 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:23.358932 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-470ef6de-5cc0-4e2c-ad49-74d04b6ac862 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:23.359479 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-470ef6de-5cc0-4e2c-ad49-74d04b6ac862 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:23.360869 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-470ef6de-5cc0-4e2c-ad49-74d04b6ac862 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:23.361973 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-470ef6de-5cc0-4e2c-ad49-74d04b6ac862 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:23.362584 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-470ef6de-5cc0-4e2c-ad49-74d04b6ac862 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:23.506669 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-470ef6de-5cc0-4e2c-ad49-74d04b6ac862 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:23.514930 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-470ef6de-5cc0-4e2c-ad49-74d04b6ac862 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1513 microversion: 2.1 time: 0.170429 Sep 15 13:11:23.515940 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 520/1024] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:23 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:24.303265 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f472d358-2a37-406f-b7b9-799debd2bd25 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:24.303982 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f472d358-2a37-406f-b7b9-799debd2bd25 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:24.310155 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f472d358-2a37-406f-b7b9-799debd2bd25 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:24.310641 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f472d358-2a37-406f-b7b9-799debd2bd25 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:24.311079 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f472d358-2a37-406f-b7b9-799debd2bd25 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:24.311771 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f472d358-2a37-406f-b7b9-799debd2bd25 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:24.312228 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f472d358-2a37-406f-b7b9-799debd2bd25 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:24.312682 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f472d358-2a37-406f-b7b9-799debd2bd25 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:24.539609 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-cc5ee6d4-33eb-402d-80d6-af4dc75c31d7 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:24.540345 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-cc5ee6d4-33eb-402d-80d6-af4dc75c31d7 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:24.546733 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc5ee6d4-33eb-402d-80d6-af4dc75c31d7 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:24.547223 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc5ee6d4-33eb-402d-80d6-af4dc75c31d7 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:24.547660 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc5ee6d4-33eb-402d-80d6-af4dc75c31d7 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:24.548394 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc5ee6d4-33eb-402d-80d6-af4dc75c31d7 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:24.549695 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc5ee6d4-33eb-402d-80d6-af4dc75c31d7 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:24.549944 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-cc5ee6d4-33eb-402d-80d6-af4dc75c31d7 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:24.637113 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f472d358-2a37-406f-b7b9-799debd2bd25 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:24.645593 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f472d358-2a37-406f-b7b9-799debd2bd25 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1265 microversion: 2.1 time: 0.346634 Sep 15 13:11:24.647066 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 505/1025] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:24 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1265 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:24.698324 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-cc5ee6d4-33eb-402d-80d6-af4dc75c31d7 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:24.706585 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-cc5ee6d4-33eb-402d-80d6-af4dc75c31d7 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1513 microversion: 2.1 time: 0.170864 Sep 15 13:11:24.707147 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 521/1026] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:24 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:11:24.878711 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-19681e6d-fbef-4590-8b2a-588ca34adb26 req-c71048ae-f2ef-4c89-bd27-0bf7a1559904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f", "name": "network-vif-deleted", "tag": "e45a4356-1f3c-4ae5-a251-e800af83443e"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:11:24.888093 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-19681e6d-fbef-4590-8b2a-588ca34adb26 req-c71048ae-f2ef-4c89-bd27-0bf7a1559904 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:24.888595 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-19681e6d-fbef-4590-8b2a-588ca34adb26 req-c71048ae-f2ef-4c89-bd27-0bf7a1559904 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:24.889035 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-19681e6d-fbef-4590-8b2a-588ca34adb26 req-c71048ae-f2ef-4c89-bd27-0bf7a1559904 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:24.900610 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-19681e6d-fbef-4590-8b2a-588ca34adb26 req-c71048ae-f2ef-4c89-bd27-0bf7a1559904 service nova] Creating event network-vif-deleted:e45a4356-1f3c-4ae5-a251-e800af83443e for instance d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f on hv-cinder-83608 Sep 15 13:11:24.905352 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-19681e6d-fbef-4590-8b2a-588ca34adb26 req-c71048ae-f2ef-4c89-bd27-0bf7a1559904 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030588 Sep 15 13:11:24.905917 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 506/1027] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:11:25.671533 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d2c8af6a-c755-4641-a7e5-34c8a1853f29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:25.672365 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d2c8af6a-c755-4641-a7e5-34c8a1853f29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:25.679174 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2c8af6a-c755-4641-a7e5-34c8a1853f29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:25.679665 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2c8af6a-c755-4641-a7e5-34c8a1853f29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:25.680106 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2c8af6a-c755-4641-a7e5-34c8a1853f29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:25.680836 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2c8af6a-c755-4641-a7e5-34c8a1853f29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:25.681288 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2c8af6a-c755-4641-a7e5-34c8a1853f29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:25.681716 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2c8af6a-c755-4641-a7e5-34c8a1853f29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:25.730740 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-72b6ab6d-ee1d-46de-8455-8d84e5d59aee tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:25.731659 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-72b6ab6d-ee1d-46de-8455-8d84e5d59aee tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:25.740127 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72b6ab6d-ee1d-46de-8455-8d84e5d59aee tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:25.740810 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72b6ab6d-ee1d-46de-8455-8d84e5d59aee tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:25.741421 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72b6ab6d-ee1d-46de-8455-8d84e5d59aee tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:25.742546 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72b6ab6d-ee1d-46de-8455-8d84e5d59aee tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:25.743477 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72b6ab6d-ee1d-46de-8455-8d84e5d59aee tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:25.744030 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72b6ab6d-ee1d-46de-8455-8d84e5d59aee tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:25.780104 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72b6ab6d-ee1d-46de-8455-8d84e5d59aee tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:25.780644 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72b6ab6d-ee1d-46de-8455-8d84e5d59aee tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:25.781077 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-72b6ab6d-ee1d-46de-8455-8d84e5d59aee tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:25.781738 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-72b6ab6d-ee1d-46de-8455-8d84e5d59aee tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lazy-loading 'fault' on Instance uuid d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:11:25.825747 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d2c8af6a-c755-4641-a7e5-34c8a1853f29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:25.834315 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-72b6ab6d-ee1d-46de-8455-8d84e5d59aee tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:25.835540 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d2c8af6a-c755-4641-a7e5-34c8a1853f29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1265 microversion: 2.1 time: 0.167278 Sep 15 13:11:25.842032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 522/1028] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:25 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:25.848128 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-72b6ab6d-ee1d-46de-8455-8d84e5d59aee tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 200 len: 1308 microversion: 2.1 time: 0.121975 Sep 15 13:11:25.848719 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 507/1029] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:25 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 1308 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:11:26.859451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-db292eeb-a7f3-4724-987b-e38ecb260f02 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:26.860094 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-db292eeb-a7f3-4724-987b-e38ecb260f02 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:26.866825 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db292eeb-a7f3-4724-987b-e38ecb260f02 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:26.867307 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db292eeb-a7f3-4724-987b-e38ecb260f02 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:26.867736 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db292eeb-a7f3-4724-987b-e38ecb260f02 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:26.868452 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db292eeb-a7f3-4724-987b-e38ecb260f02 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:26.868900 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db292eeb-a7f3-4724-987b-e38ecb260f02 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:26.869309 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-db292eeb-a7f3-4724-987b-e38ecb260f02 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:26.870698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d38b2ecb-e304-4473-9870-1d88ce84baa6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:26.871307 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d38b2ecb-e304-4473-9870-1d88ce84baa6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:26.877364 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d38b2ecb-e304-4473-9870-1d88ce84baa6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:26.878565 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d38b2ecb-e304-4473-9870-1d88ce84baa6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:26.879007 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d38b2ecb-e304-4473-9870-1d88ce84baa6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:26.879698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d38b2ecb-e304-4473-9870-1d88ce84baa6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:26.880153 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d38b2ecb-e304-4473-9870-1d88ce84baa6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:26.880611 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d38b2ecb-e304-4473-9870-1d88ce84baa6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:26.894507 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-d38b2ecb-e304-4473-9870-1d88ce84baa6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] HTTP exception thrown: Instance d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f could not be found. Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d38b2ecb-e304-4473-9870-1d88ce84baa6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Request method failure captured: Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f HTTP/1.1 Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyQxz0TdkLiUT3nLWzDZeqLrRDJCw3vSFn7ut56tz4B49pReXWnguwalnKKkYzHWxSQ5kgxQwHKTTtpoNKsiIz6MvFxaPFQwIoRJGoMMfSj6e2st2oamEcwusL5y3OTTvEX-Bh7nHYuTSxY2cxhJIvIUfpDkARW-0nAloEAs76uvdU0 Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 9d04252e755e423eaf19e824f1c8c516 Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-VolumesSnapshotTestJSON-801865197 Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:11:26.896148 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:11:26.898145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9d04252e755e423eaf19e824f1c8c516", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d04252e755e423eaf19e824f1c8c516"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d04252e755e423eaf19e824f1c8c516"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9d04252e755e423eaf19e824f1c8c516"}]}] Sep 15 13:11:26.898145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-VolumesSnapshotTestJSON-801865197 Sep 15 13:11:26.898145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 9d04252e755e423eaf19e824f1c8c516 Sep 15 13:11:26.898145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-801865197 Sep 15 13:11:26.898145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-VolumesSnapshotTestJSON-801865197-project Sep 15 13:11:26.898145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:11:26.898145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:11:26.898145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: b4ce1e64fa924abeb7a1e5292a3ca96a Sep 15 13:11:26.898145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-VolumesSnapshotTestJSON-801865197-project Sep 15 13:11:26.898145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:11:26.898145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f could not be found. Sep 15 13:11:26.898145 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': 'd25a36b5-2fd2-4ef4-b945-3c4b0f038f1f'} Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f could not be found. Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:11:26.899317 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f could not be found. Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f could not be found. Sep 15 13:11:26.900678 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:11:26.901860 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d38b2ecb-e304-4473-9870-1d88ce84baa6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Returning 404 to user: Instance d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:11:26.901860 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d38b2ecb-e304-4473-9870-1d88ce84baa6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f" status: 404 len: 111 microversion: 2.1 time: 0.030643 Sep 15 13:11:26.901860 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 508/1030] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:26 2022] GET /compute/v2.1/servers/d25a36b5-2fd2-4ef4-b945-3c4b0f038f1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 13:11:27.009852 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-db292eeb-a7f3-4724-987b-e38ecb260f02 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:27.018049 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-db292eeb-a7f3-4724-987b-e38ecb260f02 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1265 microversion: 2.1 time: 0.162600 Sep 15 13:11:27.032303 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 523/1031] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:26 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:28.041481 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-47f98475-b66e-4db9-8615-c57147a158b6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:28.042104 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-47f98475-b66e-4db9-8615-c57147a158b6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:28.048563 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-47f98475-b66e-4db9-8615-c57147a158b6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:28.049046 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-47f98475-b66e-4db9-8615-c57147a158b6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:28.050030 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-47f98475-b66e-4db9-8615-c57147a158b6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:28.050725 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-47f98475-b66e-4db9-8615-c57147a158b6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:28.051183 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-47f98475-b66e-4db9-8615-c57147a158b6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:28.051611 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-47f98475-b66e-4db9-8615-c57147a158b6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:28.182088 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-47f98475-b66e-4db9-8615-c57147a158b6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:28.189670 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-47f98475-b66e-4db9-8615-c57147a158b6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1265 microversion: 2.1 time: 0.152244 Sep 15 13:11:28.190880 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 509/1032] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:28 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:29.211734 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7580c1c3-295c-4d2b-8314-fe80d78a851c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:29.212412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7580c1c3-295c-4d2b-8314-fe80d78a851c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:29.218782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7580c1c3-295c-4d2b-8314-fe80d78a851c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:29.219266 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7580c1c3-295c-4d2b-8314-fe80d78a851c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:29.219701 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7580c1c3-295c-4d2b-8314-fe80d78a851c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:29.220418 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7580c1c3-295c-4d2b-8314-fe80d78a851c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:29.220872 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7580c1c3-295c-4d2b-8314-fe80d78a851c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:29.221850 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7580c1c3-295c-4d2b-8314-fe80d78a851c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:29.348897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7580c1c3-295c-4d2b-8314-fe80d78a851c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:29.356412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7580c1c3-295c-4d2b-8314-fe80d78a851c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1265 microversion: 2.1 time: 0.148497 Sep 15 13:11:29.356969 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 524/1033] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:29 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:30.380343 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-031b8d5b-70f7-4003-bca8-00b8cb29270a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:30.380883 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-031b8d5b-70f7-4003-bca8-00b8cb29270a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:30.383273 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:30.383935 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=6 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:30.390409 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-031b8d5b-70f7-4003-bca8-00b8cb29270a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:30.390895 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-031b8d5b-70f7-4003-bca8-00b8cb29270a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:30.391336 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-031b8d5b-70f7-4003-bca8-00b8cb29270a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:30.392027 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-031b8d5b-70f7-4003-bca8-00b8cb29270a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:30.392540 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-031b8d5b-70f7-4003-bca8-00b8cb29270a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:30.392966 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-031b8d5b-70f7-4003-bca8-00b8cb29270a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:30.519437 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-031b8d5b-70f7-4003-bca8-00b8cb29270a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:30.527323 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-031b8d5b-70f7-4003-bca8-00b8cb29270a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1265 microversion: 2.1 time: 0.151584 Sep 15 13:11:30.527890 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 510/1034] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:30 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:31.550417 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d1dc290c-b634-46db-b3d7-3456384994ff tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:31.551055 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d1dc290c-b634-46db-b3d7-3456384994ff tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:31.553085 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:31.562212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d1dc290c-b634-46db-b3d7-3456384994ff tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:31.562705 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d1dc290c-b634-46db-b3d7-3456384994ff tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:31.563143 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d1dc290c-b634-46db-b3d7-3456384994ff tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:31.563864 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d1dc290c-b634-46db-b3d7-3456384994ff tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:31.564320 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d1dc290c-b634-46db-b3d7-3456384994ff tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:31.564753 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d1dc290c-b634-46db-b3d7-3456384994ff tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:31.700689 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d1dc290c-b634-46db-b3d7-3456384994ff tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:31.709545 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d1dc290c-b634-46db-b3d7-3456384994ff tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1265 microversion: 2.1 time: 0.163050 Sep 15 13:11:31.710288 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 525/1035] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:31 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:32.732773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-df390826-66de-42c3-bb8f-c04eb824654d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:32.733440 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-df390826-66de-42c3-bb8f-c04eb824654d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:32.740409 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df390826-66de-42c3-bb8f-c04eb824654d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:32.740895 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df390826-66de-42c3-bb8f-c04eb824654d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:32.741331 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df390826-66de-42c3-bb8f-c04eb824654d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:32.742022 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df390826-66de-42c3-bb8f-c04eb824654d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:32.742476 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df390826-66de-42c3-bb8f-c04eb824654d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:32.742901 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-df390826-66de-42c3-bb8f-c04eb824654d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:32.875716 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-df390826-66de-42c3-bb8f-c04eb824654d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:32.883681 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-df390826-66de-42c3-bb8f-c04eb824654d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1265 microversion: 2.1 time: 0.154785 Sep 15 13:11:32.884301 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 511/1036] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:32 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:33.906157 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2a83dfb7-fce8-4462-b9f2-8c85662461c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:33.906773 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2a83dfb7-fce8-4462-b9f2-8c85662461c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:33.913289 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2a83dfb7-fce8-4462-b9f2-8c85662461c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:33.913770 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2a83dfb7-fce8-4462-b9f2-8c85662461c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:33.914205 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2a83dfb7-fce8-4462-b9f2-8c85662461c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:33.914897 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2a83dfb7-fce8-4462-b9f2-8c85662461c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:33.915351 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2a83dfb7-fce8-4462-b9f2-8c85662461c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:33.915775 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2a83dfb7-fce8-4462-b9f2-8c85662461c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:34.046041 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2a83dfb7-fce8-4462-b9f2-8c85662461c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:34.053769 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2a83dfb7-fce8-4462-b9f2-8c85662461c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1265 microversion: 2.1 time: 0.151601 Sep 15 13:11:34.054331 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 526/1037] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:33 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:35.076489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-bce53550-ff3e-43d2-b9bd-e4424890ac65 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:35.077095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-bce53550-ff3e-43d2-b9bd-e4424890ac65 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:35.084252 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bce53550-ff3e-43d2-b9bd-e4424890ac65 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:35.084754 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bce53550-ff3e-43d2-b9bd-e4424890ac65 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:35.085183 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bce53550-ff3e-43d2-b9bd-e4424890ac65 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:35.085870 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bce53550-ff3e-43d2-b9bd-e4424890ac65 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:35.086315 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bce53550-ff3e-43d2-b9bd-e4424890ac65 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:35.086728 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-bce53550-ff3e-43d2-b9bd-e4424890ac65 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:35.220064 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-bce53550-ff3e-43d2-b9bd-e4424890ac65 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:35.227985 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-bce53550-ff3e-43d2-b9bd-e4424890ac65 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1265 microversion: 2.1 time: 0.155306 Sep 15 13:11:35.228603 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 512/1038] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:35 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:36.250745 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d5f980c4-76f8-4049-b4d9-2d6c04621510 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:36.251357 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d5f980c4-76f8-4049-b4d9-2d6c04621510 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:36.257836 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d5f980c4-76f8-4049-b4d9-2d6c04621510 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:36.258339 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d5f980c4-76f8-4049-b4d9-2d6c04621510 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:36.258772 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d5f980c4-76f8-4049-b4d9-2d6c04621510 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:36.259463 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d5f980c4-76f8-4049-b4d9-2d6c04621510 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:36.259912 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d5f980c4-76f8-4049-b4d9-2d6c04621510 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:36.260373 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d5f980c4-76f8-4049-b4d9-2d6c04621510 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:36.388585 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d5f980c4-76f8-4049-b4d9-2d6c04621510 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:36.396740 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d5f980c4-76f8-4049-b4d9-2d6c04621510 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1265 microversion: 2.1 time: 0.149835 Sep 15 13:11:36.397547 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 527/1039] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:36 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:37.420483 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e1854b9e-7959-4717-b6a4-3158384f89e2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:37.421013 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-e1854b9e-7959-4717-b6a4-3158384f89e2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:37.428561 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e1854b9e-7959-4717-b6a4-3158384f89e2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:37.429039 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e1854b9e-7959-4717-b6a4-3158384f89e2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:37.429469 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e1854b9e-7959-4717-b6a4-3158384f89e2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:37.430147 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e1854b9e-7959-4717-b6a4-3158384f89e2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:37.430589 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e1854b9e-7959-4717-b6a4-3158384f89e2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:37.431006 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e1854b9e-7959-4717-b6a4-3158384f89e2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:37.729489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e1854b9e-7959-4717-b6a4-3158384f89e2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:37.736052 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e1854b9e-7959-4717-b6a4-3158384f89e2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1265 microversion: 2.1 time: 0.319552 Sep 15 13:11:37.737039 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 513/1040] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:37 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1265 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:37.886651 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-153279896", "imageRef": "0679b3f4-a7b2-4296-921c-6bcc02687203", "flavorRef": "452", "networks": [{"uuid": "dfb75596-7d80-4835-8571-ad93dfcc0300"}]}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:11:37.887997 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-0634052d-d461-4bb9-b388-709d20f4de87 req-3585b061-b879-4a53-83f0-5456844a2f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f2714f-b4cf-431b-b172-22bb4feb5e27", "name": "network-vif-plugged", "status": "completed", "tag": "93e2cbdf-d2a6-4d91-93d8-dead8f9bc2b6"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:11:37.898891 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-0634052d-d461-4bb9-b388-709d20f4de87 req-3585b061-b879-4a53-83f0-5456844a2f79 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:37.899365 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-0634052d-d461-4bb9-b388-709d20f4de87 req-3585b061-b879-4a53-83f0-5456844a2f79 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:37.899799 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-0634052d-d461-4bb9-b388-709d20f4de87 req-3585b061-b879-4a53-83f0-5456844a2f79 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:37.912353 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-0634052d-d461-4bb9-b388-709d20f4de87 req-3585b061-b879-4a53-83f0-5456844a2f79 service nova] Creating event network-vif-plugged:93e2cbdf-d2a6-4d91-93d8-dead8f9bc2b6 for instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 on hv-cinder-83608 Sep 15 13:11:37.918022 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-0634052d-d461-4bb9-b388-709d20f4de87 req-3585b061-b879-4a53-83f0-5456844a2f79 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033657 Sep 15 13:11:37.918962 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 514/1041] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:11:37.944823 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.network.neutron [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] validate_networks() for [('dfb75596-7d80-4835-8571-ad93dfcc0300', None, None, None, None, None)] {{(pid=120633) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:11:38.402805 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Flavor limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:11:38.403227 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Image limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:11:38.403699 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Flavor pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:11:38.404107 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Image pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:11:38.404535 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:11:38.413383 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:38.413865 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:38.414298 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:38.415024 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:38.415475 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:38.415900 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:38.432874 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Getting quotas for project 9d04252e755e423eaf19e824f1c8c516. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:11:38.436811 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Getting quotas for user b4ce1e64fa924abeb7a1e5292a3ca96a and project 9d04252e755e423eaf19e824f1c8c516. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:11:38.448559 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Going to run 1 instances... {{(pid=120633) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:11:38.450803 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0679b3f4-a7b2-4296-921c-6bcc02687203',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:11:38.500232 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b4689d5f-2fd8-4a75-8449-cc1cd82dc2e2 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617340 Sep 15 13:11:38.500831 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 528/1042] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:11:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 13:11:38.513810 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-ef44e093-a4a8-48ff-b1b4-829d15651944 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:38.514511 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-ef44e093-a4a8-48ff-b1b4-829d15651944 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:38.568265 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-ef44e093-a4a8-48ff-b1b4-829d15651944 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:38.575080 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-ef44e093-a4a8-48ff-b1b4-829d15651944 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1218 microversion: 2.1 time: 0.065972 Sep 15 13:11:38.575638 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 515/1043] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:38 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:38.761090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f557babc-36c9-4277-8226-ffb5f892ef11 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:38.761900 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f557babc-36c9-4277-8226-ffb5f892ef11 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:38.768703 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f557babc-36c9-4277-8226-ffb5f892ef11 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:38.769200 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f557babc-36c9-4277-8226-ffb5f892ef11 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:38.769632 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f557babc-36c9-4277-8226-ffb5f892ef11 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:38.770325 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f557babc-36c9-4277-8226-ffb5f892ef11 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:38.770777 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f557babc-36c9-4277-8226-ffb5f892ef11 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:38.771191 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f557babc-36c9-4277-8226-ffb5f892ef11 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:38.913371 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f557babc-36c9-4277-8226-ffb5f892ef11 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:38.921762 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f557babc-36c9-4277-8226-ffb5f892ef11 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1265 microversion: 2.1 time: 0.164410 Sep 15 13:11:38.922400 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 529/1044] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:38 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:39.597717 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-212e96e7-58b1-499b-b316-0ba306c87ea6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:39.598489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-212e96e7-58b1-499b-b316-0ba306c87ea6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:39.605730 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-212e96e7-58b1-499b-b316-0ba306c87ea6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:39.606215 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-212e96e7-58b1-499b-b316-0ba306c87ea6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:39.606644 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-212e96e7-58b1-499b-b316-0ba306c87ea6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:39.607336 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-212e96e7-58b1-499b-b316-0ba306c87ea6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:39.607786 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-212e96e7-58b1-499b-b316-0ba306c87ea6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:39.608208 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-212e96e7-58b1-499b-b316-0ba306c87ea6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:39.674786 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-212e96e7-58b1-499b-b316-0ba306c87ea6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:39.682439 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-212e96e7-58b1-499b-b316-0ba306c87ea6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1270 microversion: 2.1 time: 0.088642 Sep 15 13:11:39.688219 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 516/1045] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:39 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:39.945571 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3421573e-c7ce-4e71-b476-3fa5d7547d36 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:39.946188 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3421573e-c7ce-4e71-b476-3fa5d7547d36 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:39.952753 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3421573e-c7ce-4e71-b476-3fa5d7547d36 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:39.953232 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3421573e-c7ce-4e71-b476-3fa5d7547d36 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:39.953666 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3421573e-c7ce-4e71-b476-3fa5d7547d36 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:39.954346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3421573e-c7ce-4e71-b476-3fa5d7547d36 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:39.954794 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3421573e-c7ce-4e71-b476-3fa5d7547d36 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:39.955210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3421573e-c7ce-4e71-b476-3fa5d7547d36 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:40.085279 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3421573e-c7ce-4e71-b476-3fa5d7547d36 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:40.093017 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3421573e-c7ce-4e71-b476-3fa5d7547d36 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1453 microversion: 2.1 time: 0.151387 Sep 15 13:11:40.093583 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 530/1046] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:39 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:40.115541 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3be57191-4ac9-438e-a2e8-9263f4f234a0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:40.116188 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-3be57191-4ac9-438e-a2e8-9263f4f234a0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:40.122447 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3be57191-4ac9-438e-a2e8-9263f4f234a0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:40.122938 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3be57191-4ac9-438e-a2e8-9263f4f234a0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:40.123381 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3be57191-4ac9-438e-a2e8-9263f4f234a0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:40.124079 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3be57191-4ac9-438e-a2e8-9263f4f234a0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:40.124561 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3be57191-4ac9-438e-a2e8-9263f4f234a0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:40.125020 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-3be57191-4ac9-438e-a2e8-9263f4f234a0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:40.143474 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:40.267507 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-3be57191-4ac9-438e-a2e8-9263f4f234a0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:40.275718 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3be57191-4ac9-438e-a2e8-9263f4f234a0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1453 microversion: 2.1 time: 0.164604 Sep 15 13:11:40.276493 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 517/1047] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:40 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:40.706381 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f28730b3-6a5c-48b3-90d0-255cb41909d3 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:40.707192 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f28730b3-6a5c-48b3-90d0-255cb41909d3 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:40.713426 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f28730b3-6a5c-48b3-90d0-255cb41909d3 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:40.713924 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f28730b3-6a5c-48b3-90d0-255cb41909d3 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:40.714361 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f28730b3-6a5c-48b3-90d0-255cb41909d3 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:40.715090 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f28730b3-6a5c-48b3-90d0-255cb41909d3 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:40.715546 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f28730b3-6a5c-48b3-90d0-255cb41909d3 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:40.716151 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f28730b3-6a5c-48b3-90d0-255cb41909d3 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:40.788248 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f28730b3-6a5c-48b3-90d0-255cb41909d3 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:40.796620 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f28730b3-6a5c-48b3-90d0-255cb41909d3 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1288 microversion: 2.1 time: 0.094750 Sep 15 13:11:40.797397 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 531/1048] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:40 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1288 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:41.819668 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-571c2ad4-8e4e-4269-a179-0d5f9991b3c5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:41.820300 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-571c2ad4-8e4e-4269-a179-0d5f9991b3c5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:41.826526 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-571c2ad4-8e4e-4269-a179-0d5f9991b3c5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:41.827015 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-571c2ad4-8e4e-4269-a179-0d5f9991b3c5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:41.827455 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-571c2ad4-8e4e-4269-a179-0d5f9991b3c5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:41.828150 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-571c2ad4-8e4e-4269-a179-0d5f9991b3c5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:41.828627 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-571c2ad4-8e4e-4269-a179-0d5f9991b3c5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:41.829049 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-571c2ad4-8e4e-4269-a179-0d5f9991b3c5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:41.919360 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-571c2ad4-8e4e-4269-a179-0d5f9991b3c5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:41.926950 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-571c2ad4-8e4e-4269-a179-0d5f9991b3c5 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1276 microversion: 2.1 time: 0.111798 Sep 15 13:11:41.927516 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 518/1049] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:41 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1276 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:42.950782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2af24809-4e72-42b6-8002-5a87d26d7c04 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:42.951443 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2af24809-4e72-42b6-8002-5a87d26d7c04 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:42.958181 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2af24809-4e72-42b6-8002-5a87d26d7c04 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:42.958663 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2af24809-4e72-42b6-8002-5a87d26d7c04 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:42.959103 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2af24809-4e72-42b6-8002-5a87d26d7c04 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:42.959796 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2af24809-4e72-42b6-8002-5a87d26d7c04 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:42.960248 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2af24809-4e72-42b6-8002-5a87d26d7c04 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:42.960688 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2af24809-4e72-42b6-8002-5a87d26d7c04 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:43.112621 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2af24809-4e72-42b6-8002-5a87d26d7c04 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:43.121573 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2af24809-4e72-42b6-8002-5a87d26d7c04 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1318 microversion: 2.1 time: 0.174672 Sep 15 13:11:43.136990 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-ad822dc6-3ce5-45fb-bc79-91e86a0a1021 req-ac21ca62-2f1f-40b4-a456-8d2d02294485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1f2714f-b4cf-431b-b172-22bb4feb5e27", "tag": "93e2cbdf-d2a6-4d91-93d8-dead8f9bc2b6"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:11:43.138157 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 532/1050] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:42 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:43.146714 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-ad822dc6-3ce5-45fb-bc79-91e86a0a1021 req-ac21ca62-2f1f-40b4-a456-8d2d02294485 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:43.147510 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-ad822dc6-3ce5-45fb-bc79-91e86a0a1021 req-ac21ca62-2f1f-40b4-a456-8d2d02294485 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:43.148008 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-ad822dc6-3ce5-45fb-bc79-91e86a0a1021 req-ac21ca62-2f1f-40b4-a456-8d2d02294485 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:43.159535 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-ad822dc6-3ce5-45fb-bc79-91e86a0a1021 req-ac21ca62-2f1f-40b4-a456-8d2d02294485 service nova] Creating event network-changed:93e2cbdf-d2a6-4d91-93d8-dead8f9bc2b6 for instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 on hv-cinder-83608 Sep 15 13:11:43.166186 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-ad822dc6-3ce5-45fb-bc79-91e86a0a1021 req-ac21ca62-2f1f-40b4-a456-8d2d02294485 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034992 Sep 15 13:11:43.167113 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 519/1051] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:11:44.146367 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a7089e59-b312-48d2-8403-f65a05156748 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:44.147072 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a7089e59-b312-48d2-8403-f65a05156748 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:44.156633 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a7089e59-b312-48d2-8403-f65a05156748 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:44.157311 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a7089e59-b312-48d2-8403-f65a05156748 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:44.157753 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a7089e59-b312-48d2-8403-f65a05156748 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:44.160014 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a7089e59-b312-48d2-8403-f65a05156748 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:44.160545 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a7089e59-b312-48d2-8403-f65a05156748 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:44.160974 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a7089e59-b312-48d2-8403-f65a05156748 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:44.294844 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-a7089e59-b312-48d2-8403-f65a05156748 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:44.303775 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a7089e59-b312-48d2-8403-f65a05156748 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1318 microversion: 2.1 time: 0.162378 Sep 15 13:11:44.304357 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 533/1052] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:44 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:45.182672 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-bdce857a-3b38-4963-a50b-0908682d1141 req-ee77139d-4ed5-4899-984b-328f09166d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8", "tag": "58439e37-eefc-4a8c-9760-e461eec28bbb"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:11:45.193180 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-bdce857a-3b38-4963-a50b-0908682d1141 req-ee77139d-4ed5-4899-984b-328f09166d10 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:45.193648 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-bdce857a-3b38-4963-a50b-0908682d1141 req-ee77139d-4ed5-4899-984b-328f09166d10 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:45.194066 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-bdce857a-3b38-4963-a50b-0908682d1141 req-ee77139d-4ed5-4899-984b-328f09166d10 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:45.204639 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-bdce857a-3b38-4963-a50b-0908682d1141 req-ee77139d-4ed5-4899-984b-328f09166d10 service nova] Creating event network-changed:58439e37-eefc-4a8c-9760-e461eec28bbb for instance bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 on hv-cinder-83608 Sep 15 13:11:45.210043 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-bdce857a-3b38-4963-a50b-0908682d1141 req-ee77139d-4ed5-4899-984b-328f09166d10 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031818 Sep 15 13:11:45.210602 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 520/1053] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:11:45.326499 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-def27784-8bae-4bc9-ad10-0d5e0e2f2902 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:45.327110 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-def27784-8bae-4bc9-ad10-0d5e0e2f2902 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:45.334228 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-def27784-8bae-4bc9-ad10-0d5e0e2f2902 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:45.334710 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-def27784-8bae-4bc9-ad10-0d5e0e2f2902 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:45.335142 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-def27784-8bae-4bc9-ad10-0d5e0e2f2902 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:45.335822 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-def27784-8bae-4bc9-ad10-0d5e0e2f2902 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:45.336291 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-def27784-8bae-4bc9-ad10-0d5e0e2f2902 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:45.336715 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-def27784-8bae-4bc9-ad10-0d5e0e2f2902 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:45.466783 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-def27784-8bae-4bc9-ad10-0d5e0e2f2902 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:45.470178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=100 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:45.475650 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-def27784-8bae-4bc9-ad10-0d5e0e2f2902 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1318 microversion: 2.1 time: 0.152971 Sep 15 13:11:45.476211 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 534/1054] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:45 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:46.499113 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-101f7f3b-9fbb-4e20-9992-121a1f9b26d8 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:46.499805 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-101f7f3b-9fbb-4e20-9992-121a1f9b26d8 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:46.508459 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-101f7f3b-9fbb-4e20-9992-121a1f9b26d8 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:46.508946 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-101f7f3b-9fbb-4e20-9992-121a1f9b26d8 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:46.509601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-101f7f3b-9fbb-4e20-9992-121a1f9b26d8 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:46.510538 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-101f7f3b-9fbb-4e20-9992-121a1f9b26d8 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:46.511667 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-101f7f3b-9fbb-4e20-9992-121a1f9b26d8 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:46.512261 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-101f7f3b-9fbb-4e20-9992-121a1f9b26d8 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:46.959948 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-101f7f3b-9fbb-4e20-9992-121a1f9b26d8 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:46.967610 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-101f7f3b-9fbb-4e20-9992-121a1f9b26d8 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1318 microversion: 2.1 time: 0.472719 Sep 15 13:11:46.980452 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 521/1055] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:46 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:47.991451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-867efd39-dab0-4b13-a763-0ff462ca4a1f tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:47.991998 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-867efd39-dab0-4b13-a763-0ff462ca4a1f tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:47.998930 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-867efd39-dab0-4b13-a763-0ff462ca4a1f tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:47.999419 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-867efd39-dab0-4b13-a763-0ff462ca4a1f tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:47.999856 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-867efd39-dab0-4b13-a763-0ff462ca4a1f tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:48.000613 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-867efd39-dab0-4b13-a763-0ff462ca4a1f tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:48.001070 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-867efd39-dab0-4b13-a763-0ff462ca4a1f tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:48.001496 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-867efd39-dab0-4b13-a763-0ff462ca4a1f tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:48.131413 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-867efd39-dab0-4b13-a763-0ff462ca4a1f tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:48.139040 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-867efd39-dab0-4b13-a763-0ff462ca4a1f tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1318 microversion: 2.1 time: 0.151684 Sep 15 13:11:48.139597 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 535/1056] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:47 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:49.161572 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f727d477-d0af-4925-a601-711206796aec tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:49.162183 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-f727d477-d0af-4925-a601-711206796aec tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:49.164633 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:49.165279 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:49.170687 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f727d477-d0af-4925-a601-711206796aec tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:49.171168 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f727d477-d0af-4925-a601-711206796aec tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:49.171603 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f727d477-d0af-4925-a601-711206796aec tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:49.172312 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f727d477-d0af-4925-a601-711206796aec tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:49.172771 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f727d477-d0af-4925-a601-711206796aec tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:49.173196 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-f727d477-d0af-4925-a601-711206796aec tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:49.304852 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-f727d477-d0af-4925-a601-711206796aec tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:49.312394 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f727d477-d0af-4925-a601-711206796aec tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1318 microversion: 2.1 time: 0.154984 Sep 15 13:11:49.313220 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 522/1057] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:49 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:49.873367 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-8e8a4524-6334-4971-b8d3-466e1e106734 req-6c5d335a-5afc-42ad-822e-7a27fd469bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8", "name": "network-vif-plugged", "status": "completed", "tag": "58439e37-eefc-4a8c-9760-e461eec28bbb"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:11:49.878855 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:49.879525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=6 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:49.881112 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:49.887041 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-8e8a4524-6334-4971-b8d3-466e1e106734 req-6c5d335a-5afc-42ad-822e-7a27fd469bc3 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:49.887532 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-8e8a4524-6334-4971-b8d3-466e1e106734 req-6c5d335a-5afc-42ad-822e-7a27fd469bc3 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:49.887960 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-8e8a4524-6334-4971-b8d3-466e1e106734 req-6c5d335a-5afc-42ad-822e-7a27fd469bc3 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:49.900697 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-8e8a4524-6334-4971-b8d3-466e1e106734 req-6c5d335a-5afc-42ad-822e-7a27fd469bc3 service nova] Creating event network-vif-plugged:58439e37-eefc-4a8c-9760-e461eec28bbb for instance bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 on hv-cinder-83608 Sep 15 13:11:49.906026 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-8e8a4524-6334-4971-b8d3-466e1e106734 req-6c5d335a-5afc-42ad-822e-7a27fd469bc3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036400 Sep 15 13:11:49.906779 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 536/1058] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:11:50.336203 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-69f3bdc9-3901-4dd9-8b38-4161b333aed4 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:50.336783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-69f3bdc9-3901-4dd9-8b38-4161b333aed4 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:50.343211 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69f3bdc9-3901-4dd9-8b38-4161b333aed4 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:50.343852 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69f3bdc9-3901-4dd9-8b38-4161b333aed4 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:50.344310 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69f3bdc9-3901-4dd9-8b38-4161b333aed4 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:50.345216 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69f3bdc9-3901-4dd9-8b38-4161b333aed4 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:50.345865 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69f3bdc9-3901-4dd9-8b38-4161b333aed4 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:50.346285 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-69f3bdc9-3901-4dd9-8b38-4161b333aed4 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:50.528962 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-69f3bdc9-3901-4dd9-8b38-4161b333aed4 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:50.538223 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-69f3bdc9-3901-4dd9-8b38-4161b333aed4 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1318 microversion: 2.1 time: 0.206961 Sep 15 13:11:50.538794 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 523/1059] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:50 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:51.562836 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3538dcfb-74c6-409a-a2d1-2cce3af68855 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:51.563549 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3538dcfb-74c6-409a-a2d1-2cce3af68855 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:51.570528 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3538dcfb-74c6-409a-a2d1-2cce3af68855 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:51.571218 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3538dcfb-74c6-409a-a2d1-2cce3af68855 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:51.571466 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3538dcfb-74c6-409a-a2d1-2cce3af68855 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:51.572236 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3538dcfb-74c6-409a-a2d1-2cce3af68855 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:51.572616 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3538dcfb-74c6-409a-a2d1-2cce3af68855 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:51.573330 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3538dcfb-74c6-409a-a2d1-2cce3af68855 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:51.714178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3538dcfb-74c6-409a-a2d1-2cce3af68855 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:51.723151 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3538dcfb-74c6-409a-a2d1-2cce3af68855 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1318 microversion: 2.1 time: 0.165137 Sep 15 13:11:51.723737 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 537/1060] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:51 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:52.745375 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4b3cfa9e-9730-4d7e-8ad8-33776cb872d6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:11:52.745973 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-4b3cfa9e-9730-4d7e-8ad8-33776cb872d6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:52.752431 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4b3cfa9e-9730-4d7e-8ad8-33776cb872d6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:52.752912 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4b3cfa9e-9730-4d7e-8ad8-33776cb872d6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:52.754467 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4b3cfa9e-9730-4d7e-8ad8-33776cb872d6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:52.755157 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4b3cfa9e-9730-4d7e-8ad8-33776cb872d6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:52.755608 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4b3cfa9e-9730-4d7e-8ad8-33776cb872d6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:52.756031 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-4b3cfa9e-9730-4d7e-8ad8-33776cb872d6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:52.885524 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-4b3cfa9e-9730-4d7e-8ad8-33776cb872d6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:11:52.893424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-4b3cfa9e-9730-4d7e-8ad8-33776cb872d6 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1506 microversion: 2.1 time: 0.151932 Sep 15 13:11:52.894045 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 524/1061] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:11:52 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:11:52.916624 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-a80dc6dc-f5cf-4bba-9fa8-b1e53476c1ed tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44650b6d-653e-4639-a433-0863a91a60b2", "device": "/dev/sdb"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:11:52.918988 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-a80dc6dc-f5cf-4bba-9fa8-b1e53476c1ed tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:11:52.926230 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a80dc6dc-f5cf-4bba-9fa8-b1e53476c1ed tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:52.926712 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a80dc6dc-f5cf-4bba-9fa8-b1e53476c1ed tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:52.927156 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a80dc6dc-f5cf-4bba-9fa8-b1e53476c1ed tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:52.927847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a80dc6dc-f5cf-4bba-9fa8-b1e53476c1ed tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:11:52.928324 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a80dc6dc-f5cf-4bba-9fa8-b1e53476c1ed tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:11:52.928751 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-a80dc6dc-f5cf-4bba-9fa8-b1e53476c1ed tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:11:53.183041 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-a80dc6dc-f5cf-4bba-9fa8-b1e53476c1ed tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "POST /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270179 Sep 15 13:11:53.189186 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 538/1062] 10.222.0.57 () {60 vars in 1323 bytes} [Thu Sep 15 13:11:52 2022] POST /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:12:07.571756 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c7ee93e9-01cc-40ae-b560-e9c4f99bb37e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-752529055"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:12:07.572405 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-c7ee93e9-01cc-40ae-b560-e9c4f99bb37e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:07.574257 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=5 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:12:07.574895 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=36 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:12:07.580776 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c7ee93e9-01cc-40ae-b560-e9c4f99bb37e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:07.581253 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c7ee93e9-01cc-40ae-b560-e9c4f99bb37e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:07.581718 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c7ee93e9-01cc-40ae-b560-e9c4f99bb37e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:07.582401 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c7ee93e9-01cc-40ae-b560-e9c4f99bb37e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:07.582867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c7ee93e9-01cc-40ae-b560-e9c4f99bb37e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:07.583291 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-c7ee93e9-01cc-40ae-b560-e9c4f99bb37e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:07.716308 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.network.security_group_api [None req-c7ee93e9-01cc-40ae-b560-e9c4f99bb37e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Removing security group 0f1a6ec3-56b3-4108-a5c2-6f34c3a1808b from port 8664056d-9981-4374-9627-df05e9500424 Sep 15 13:12:08.017505 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c7ee93e9-01cc-40ae-b560-e9c4f99bb37e tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "POST /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/action" status: 202 len: 0 microversion: 2.1 time: 0.450140 Sep 15 13:12:08.018166 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 525/1063] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Sep 15 13:12:07 2022] POST /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:12:08.030081 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-8aff50b2-e91e-41f6-970d-02239ff687dc req-f28c9f8a-5edf-4377-ac3e-d5c1c9562364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6fe9060-6085-4ae1-90d1-dc0ed730c243", "tag": "8664056d-9981-4374-9627-df05e9500424"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:12:08.036417 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=5 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:12:08.037260 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:12:08.044464 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-8aff50b2-e91e-41f6-970d-02239ff687dc req-f28c9f8a-5edf-4377-ac3e-d5c1c9562364 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:08.044996 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-8aff50b2-e91e-41f6-970d-02239ff687dc req-f28c9f8a-5edf-4377-ac3e-d5c1c9562364 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:08.045445 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-8aff50b2-e91e-41f6-970d-02239ff687dc req-f28c9f8a-5edf-4377-ac3e-d5c1c9562364 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:08.059047 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-8aff50b2-e91e-41f6-970d-02239ff687dc req-f28c9f8a-5edf-4377-ac3e-d5c1c9562364 service nova] Creating event network-changed:8664056d-9981-4374-9627-df05e9500424 for instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 on hv-cinder-83608 Sep 15 13:12:08.064299 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-8aff50b2-e91e-41f6-970d-02239ff687dc req-f28c9f8a-5edf-4377-ac3e-d5c1c9562364 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042237 Sep 15 13:12:08.065651 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 539/1064] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 13:12:08.990986 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-13429527-b57a-4a03-8806-de0e0bda1cd8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:08.991572 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-13429527-b57a-4a03-8806-de0e0bda1cd8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:08.997534 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13429527-b57a-4a03-8806-de0e0bda1cd8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:08.998022 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13429527-b57a-4a03-8806-de0e0bda1cd8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:08.998462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13429527-b57a-4a03-8806-de0e0bda1cd8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:08.999157 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13429527-b57a-4a03-8806-de0e0bda1cd8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:08.999618 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13429527-b57a-4a03-8806-de0e0bda1cd8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:09.000049 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-13429527-b57a-4a03-8806-de0e0bda1cd8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:09.082347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-13429527-b57a-4a03-8806-de0e0bda1cd8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lazy-loading 'services' on Instance uuid d6fe9060-6085-4ae1-90d1-dc0ed730c243 {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:12:09.156132 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-13429527-b57a-4a03-8806-de0e0bda1cd8 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments/9d3d0b55-c294-4866-b5f1-b1d6a650bd22" status: 202 len: 0 microversion: 2.1 time: 0.169307 Sep 15 13:12:09.159999 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 526/1065] 10.222.0.57 () {58 vars in 1416 bytes} [Thu Sep 15 13:12:08 2022] DELETE /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments/9d3d0b55-c294-4866-b5f1-b1d6a650bd22 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 13:12:09.166406 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-834fe359-214c-4490-bb2a-e6e6b73557bc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:09.168816 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-834fe359-214c-4490-bb2a-e6e6b73557bc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:09.176047 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-834fe359-214c-4490-bb2a-e6e6b73557bc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:09.176556 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-834fe359-214c-4490-bb2a-e6e6b73557bc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:09.177030 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-834fe359-214c-4490-bb2a-e6e6b73557bc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:09.178264 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-834fe359-214c-4490-bb2a-e6e6b73557bc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:09.178775 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-834fe359-214c-4490-bb2a-e6e6b73557bc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:09.179371 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-834fe359-214c-4490-bb2a-e6e6b73557bc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:09.212518 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-834fe359-214c-4490-bb2a-e6e6b73557bc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050960 Sep 15 13:12:09.213405 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 540/1066] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:12:09 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:12:10.079398 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-95616093-6c60-4a0e-9291-13dd13f3cf76 req-1d92c5ec-a4e7-456f-80a5-41c73aceaa27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6fe9060-6085-4ae1-90d1-dc0ed730c243", "tag": "8664056d-9981-4374-9627-df05e9500424"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:12:10.090253 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-95616093-6c60-4a0e-9291-13dd13f3cf76 req-1d92c5ec-a4e7-456f-80a5-41c73aceaa27 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:10.090725 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-95616093-6c60-4a0e-9291-13dd13f3cf76 req-1d92c5ec-a4e7-456f-80a5-41c73aceaa27 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:10.091149 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-95616093-6c60-4a0e-9291-13dd13f3cf76 req-1d92c5ec-a4e7-456f-80a5-41c73aceaa27 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:10.104671 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-95616093-6c60-4a0e-9291-13dd13f3cf76 req-1d92c5ec-a4e7-456f-80a5-41c73aceaa27 service nova] Creating event network-changed:8664056d-9981-4374-9627-df05e9500424 for instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 on hv-cinder-83608 Sep 15 13:12:10.109598 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-95616093-6c60-4a0e-9291-13dd13f3cf76 req-1d92c5ec-a4e7-456f-80a5-41c73aceaa27 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034235 Sep 15 13:12:10.110171 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 527/1067] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:12:10.226297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c23df439-4d9e-4234-8497-4bde7b706e70 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:10.228506 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c23df439-4d9e-4234-8497-4bde7b706e70 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:10.235031 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c23df439-4d9e-4234-8497-4bde7b706e70 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:10.235515 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c23df439-4d9e-4234-8497-4bde7b706e70 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:10.235945 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c23df439-4d9e-4234-8497-4bde7b706e70 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:10.236676 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c23df439-4d9e-4234-8497-4bde7b706e70 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:10.237125 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c23df439-4d9e-4234-8497-4bde7b706e70 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:10.237548 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c23df439-4d9e-4234-8497-4bde7b706e70 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:10.267515 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c23df439-4d9e-4234-8497-4bde7b706e70 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045278 Sep 15 13:12:10.268091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 541/1068] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:12:10 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:12:11.282007 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5bec27a2-efa5-4d61-97ee-8e4cbbe09b49 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:11.284885 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5bec27a2-efa5-4d61-97ee-8e4cbbe09b49 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:11.291942 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5bec27a2-efa5-4d61-97ee-8e4cbbe09b49 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:11.292533 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5bec27a2-efa5-4d61-97ee-8e4cbbe09b49 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:11.293036 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5bec27a2-efa5-4d61-97ee-8e4cbbe09b49 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:11.293800 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5bec27a2-efa5-4d61-97ee-8e4cbbe09b49 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:11.294322 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5bec27a2-efa5-4d61-97ee-8e4cbbe09b49 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:11.294846 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5bec27a2-efa5-4d61-97ee-8e4cbbe09b49 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:11.324398 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5bec27a2-efa5-4d61-97ee-8e4cbbe09b49 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047182 Sep 15 13:12:11.324965 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 528/1069] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:12:11 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:12:12.339626 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-6cb5ebc6-0058-4803-bda7-3634fa44efa2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:12.342095 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-6cb5ebc6-0058-4803-bda7-3634fa44efa2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:12.348677 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6cb5ebc6-0058-4803-bda7-3634fa44efa2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:12.349335 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6cb5ebc6-0058-4803-bda7-3634fa44efa2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:12.351034 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6cb5ebc6-0058-4803-bda7-3634fa44efa2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:12.351818 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6cb5ebc6-0058-4803-bda7-3634fa44efa2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:12.352528 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6cb5ebc6-0058-4803-bda7-3634fa44efa2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:12.352956 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6cb5ebc6-0058-4803-bda7-3634fa44efa2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:12.386262 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-6cb5ebc6-0058-4803-bda7-3634fa44efa2 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052079 Sep 15 13:12:12.391639 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 542/1070] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:12:12 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:12:13.399974 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-76bb4198-7622-4c0b-8ada-e5b3e2c5e6ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:13.402174 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-76bb4198-7622-4c0b-8ada-e5b3e2c5e6ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:13.408819 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-76bb4198-7622-4c0b-8ada-e5b3e2c5e6ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:13.409308 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-76bb4198-7622-4c0b-8ada-e5b3e2c5e6ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:13.409744 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-76bb4198-7622-4c0b-8ada-e5b3e2c5e6ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:13.410436 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-76bb4198-7622-4c0b-8ada-e5b3e2c5e6ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:13.411330 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-76bb4198-7622-4c0b-8ada-e5b3e2c5e6ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:13.411330 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-76bb4198-7622-4c0b-8ada-e5b3e2c5e6ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:13.440574 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-76bb4198-7622-4c0b-8ada-e5b3e2c5e6ed tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045361 Sep 15 13:12:13.441132 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 529/1071] 10.222.0.57 () {58 vars in 1302 bytes} [Thu Sep 15 13:12:13 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 13:12:13.452362 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-dba86d2a-2036-4d51-9384-e55c43202a66 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:13.452863 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-dba86d2a-2036-4d51-9384-e55c43202a66 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:13.459977 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dba86d2a-2036-4d51-9384-e55c43202a66 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:13.460489 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dba86d2a-2036-4d51-9384-e55c43202a66 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:13.460925 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dba86d2a-2036-4d51-9384-e55c43202a66 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:13.461619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dba86d2a-2036-4d51-9384-e55c43202a66 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:13.462266 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dba86d2a-2036-4d51-9384-e55c43202a66 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:13.462692 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-dba86d2a-2036-4d51-9384-e55c43202a66 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:13.542053 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-dba86d2a-2036-4d51-9384-e55c43202a66 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] HTTP exception thrown: Instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 is not attached to volume 9d3d0b55-c294-4866-b5f1-b1d6a650bd22 Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-dba86d2a-2036-4d51-9384-e55c43202a66 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Request method failure captured: Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: DELETE /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments/9d3d0b55-c294-4866-b5f1-b1d6a650bd22 HTTP/1.1 Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyO-3O1G6tRYhrR_n-2PrjJLvyKUuV35Kg1kj_nHn834EauOHq85HSAweQUzBzfi5PrJAkni1pqny_K6Y_BfAHA6eeQI5aOc9pr1R5AUWfeat4Sgr4iRcug9aN96z-3VergXaUcZ9W832hIBToM5mk3rZxEJ6VT_sL15J2F-a6AHA4Q Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 8b815e753bbe4a54942550a564653fd8 Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-TestMinimumBasicScenario-293295252 Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:12:13.544458 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:12:13.546212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8b815e753bbe4a54942550a564653fd8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8b815e753bbe4a54942550a564653fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8b815e753bbe4a54942550a564653fd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8b815e753bbe4a54942550a564653fd8"}]}] Sep 15 13:12:13.546212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-TestMinimumBasicScenario-293295252 Sep 15 13:12:13.546212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 8b815e753bbe4a54942550a564653fd8 Sep 15 13:12:13.546212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-TestMinimumBasicScenario-293295252 Sep 15 13:12:13.546212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-TestMinimumBasicScenario-293295252-project Sep 15 13:12:13.546212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:12:13.546212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:12:13.546212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: fd09d576051f4b98a8a9b3ec0ca18bc8 Sep 15 13:12:13.546212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-TestMinimumBasicScenario-293295252-project Sep 15 13:12:13.546212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:12:13.546212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 is not attached to volume 9d3d0b55-c294-4866-b5f1-b1d6a650bd22 Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'server_id': 'd6fe9060-6085-4ae1-90d1-dc0ed730c243', 'id': '9d3d0b55-c294-4866-b5f1-b1d6a650bd22'} Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9d3d0b55-c294-4866-b5f1-b1d6a650bd22. Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:12:13.547202 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 is not attached to volume 9d3d0b55-c294-4866-b5f1-b1d6a650bd22 Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 is not attached to volume 9d3d0b55-c294-4866-b5f1-b1d6a650bd22 Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:12:13.548927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-dba86d2a-2036-4d51-9384-e55c43202a66 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Returning 404 to user: Instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 is not attached to volume 9d3d0b55-c294-4866-b5f1-b1d6a650bd22 {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:12:13.550172 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-dba86d2a-2036-4d51-9384-e55c43202a66 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments/9d3d0b55-c294-4866-b5f1-b1d6a650bd22" status: 404 len: 154 microversion: 2.1 time: 0.097556 Sep 15 13:12:13.550172 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 543/1072] 10.222.0.57 () {58 vars in 1416 bytes} [Thu Sep 15 13:12:13 2022] DELETE /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243/os-volume_attachments/9d3d0b55-c294-4866-b5f1-b1d6a650bd22 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:12:14.686820 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a3fa80af-03ec-46ee-9203-fa18a770d708 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:14.687316 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a3fa80af-03ec-46ee-9203-fa18a770d708 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:14.693814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a3fa80af-03ec-46ee-9203-fa18a770d708 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:14.694295 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a3fa80af-03ec-46ee-9203-fa18a770d708 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:14.694730 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a3fa80af-03ec-46ee-9203-fa18a770d708 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:14.695448 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a3fa80af-03ec-46ee-9203-fa18a770d708 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:14.695904 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a3fa80af-03ec-46ee-9203-fa18a770d708 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:14.696350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a3fa80af-03ec-46ee-9203-fa18a770d708 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:14.720621 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a3fa80af-03ec-46ee-9203-fa18a770d708 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Going to try to terminate instance {{(pid=120634) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:12:14.794623 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a3fa80af-03ec-46ee-9203-fa18a770d708 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 204 len: 0 microversion: 2.1 time: 0.111323 Sep 15 13:12:14.795200 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 530/1073] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:12:14 2022] DELETE /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:12:14.804512 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2b1f9761-d771-48d7-a4b2-e01ead3418df tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:14.805254 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2b1f9761-d771-48d7-a4b2-e01ead3418df tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:14.811688 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2b1f9761-d771-48d7-a4b2-e01ead3418df tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:14.812173 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2b1f9761-d771-48d7-a4b2-e01ead3418df tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:14.812647 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2b1f9761-d771-48d7-a4b2-e01ead3418df tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:14.813347 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2b1f9761-d771-48d7-a4b2-e01ead3418df tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:14.813806 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2b1f9761-d771-48d7-a4b2-e01ead3418df tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:14.814232 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2b1f9761-d771-48d7-a4b2-e01ead3418df tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:14.951816 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-2b1f9761-d771-48d7-a4b2-e01ead3418df tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:12:14.960254 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2b1f9761-d771-48d7-a4b2-e01ead3418df tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1554 microversion: 2.1 time: 0.160644 Sep 15 13:12:14.960834 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 544/1074] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:12:14 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:12:15.649623 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-36a4646c-7273-4dd0-a928-27494a3db467 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:15.650213 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-36a4646c-7273-4dd0-a928-27494a3db467 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:15.656131 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-36a4646c-7273-4dd0-a928-27494a3db467 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:15.656644 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-36a4646c-7273-4dd0-a928-27494a3db467 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:15.657081 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-36a4646c-7273-4dd0-a928-27494a3db467 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:15.657773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-36a4646c-7273-4dd0-a928-27494a3db467 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:15.658227 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-36a4646c-7273-4dd0-a928-27494a3db467 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:15.658654 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-36a4646c-7273-4dd0-a928-27494a3db467 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:15.743185 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-36a4646c-7273-4dd0-a928-27494a3db467 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lazy-loading 'services' on Instance uuid bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:12:15.813493 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-36a4646c-7273-4dd0-a928-27494a3db467 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8/os-volume_attachments/44650b6d-653e-4639-a433-0863a91a60b2" status: 202 len: 0 microversion: 2.1 time: 0.168680 Sep 15 13:12:15.814075 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 531/1075] 10.222.0.57 () {58 vars in 1416 bytes} [Thu Sep 15 13:12:15 2022] DELETE /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8/os-volume_attachments/44650b6d-653e-4639-a433-0863a91a60b2 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:12:15.983327 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-475486d3-aca2-45a2-ac54-186dd8e86830 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:15.983949 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-475486d3-aca2-45a2-ac54-186dd8e86830 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:15.990514 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-475486d3-aca2-45a2-ac54-186dd8e86830 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:15.990994 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-475486d3-aca2-45a2-ac54-186dd8e86830 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:15.991470 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-475486d3-aca2-45a2-ac54-186dd8e86830 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:15.992161 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-475486d3-aca2-45a2-ac54-186dd8e86830 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:15.992643 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-475486d3-aca2-45a2-ac54-186dd8e86830 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:15.993070 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-475486d3-aca2-45a2-ac54-186dd8e86830 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:16.124046 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-475486d3-aca2-45a2-ac54-186dd8e86830 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:12:16.134061 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-475486d3-aca2-45a2-ac54-186dd8e86830 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1554 microversion: 2.1 time: 0.154636 Sep 15 13:12:16.134644 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 545/1076] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:12:15 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:12:17.158398 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-324828d3-910f-4a48-aec9-55bff87c706c tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:17.159112 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-324828d3-910f-4a48-aec9-55bff87c706c tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:17.165864 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-324828d3-910f-4a48-aec9-55bff87c706c tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:17.166350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-324828d3-910f-4a48-aec9-55bff87c706c tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:17.166791 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-324828d3-910f-4a48-aec9-55bff87c706c tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:17.167485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-324828d3-910f-4a48-aec9-55bff87c706c tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:17.167945 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-324828d3-910f-4a48-aec9-55bff87c706c tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:17.168465 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-324828d3-910f-4a48-aec9-55bff87c706c tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:17.337821 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-324828d3-910f-4a48-aec9-55bff87c706c tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:12:17.345536 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-324828d3-910f-4a48-aec9-55bff87c706c tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1554 microversion: 2.1 time: 0.191823 Sep 15 13:12:17.346100 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 532/1077] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:12:17 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1554 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:12:17.779143 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-4b5866b1-af8e-48e3-a794-81fe4145ca09 req-03d80a91-9c70-4e0b-b250-3a6075818c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6fe9060-6085-4ae1-90d1-dc0ed730c243", "name": "network-vif-deleted", "tag": "8664056d-9981-4374-9627-df05e9500424"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:12:17.791772 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-4b5866b1-af8e-48e3-a794-81fe4145ca09 req-03d80a91-9c70-4e0b-b250-3a6075818c06 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:17.792259 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-4b5866b1-af8e-48e3-a794-81fe4145ca09 req-03d80a91-9c70-4e0b-b250-3a6075818c06 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:17.792723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-4b5866b1-af8e-48e3-a794-81fe4145ca09 req-03d80a91-9c70-4e0b-b250-3a6075818c06 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:17.806480 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-4b5866b1-af8e-48e3-a794-81fe4145ca09 req-03d80a91-9c70-4e0b-b250-3a6075818c06 service nova] Creating event network-vif-deleted:8664056d-9981-4374-9627-df05e9500424 for instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 on hv-cinder-83608 Sep 15 13:12:17.811421 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-4b5866b1-af8e-48e3-a794-81fe4145ca09 req-03d80a91-9c70-4e0b-b250-3a6075818c06 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037004 Sep 15 13:12:17.812009 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 546/1078] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:12:17.994212 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-7be1185e-e674-4907-a279-c0e43afaf9c0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:17.994711 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-7be1185e-e674-4907-a279-c0e43afaf9c0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:18.000592 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7be1185e-e674-4907-a279-c0e43afaf9c0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:18.001079 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7be1185e-e674-4907-a279-c0e43afaf9c0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:18.001516 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7be1185e-e674-4907-a279-c0e43afaf9c0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:18.002223 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7be1185e-e674-4907-a279-c0e43afaf9c0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:18.002664 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7be1185e-e674-4907-a279-c0e43afaf9c0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:18.003094 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-7be1185e-e674-4907-a279-c0e43afaf9c0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:18.029889 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-7be1185e-e674-4907-a279-c0e43afaf9c0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Going to try to terminate instance {{(pid=120634) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:12:18.111112 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-7be1185e-e674-4907-a279-c0e43afaf9c0 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 204 len: 0 microversion: 2.1 time: 0.120926 Sep 15 13:12:18.111993 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 533/1079] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:12:17 2022] DELETE /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:12:18.121501 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-05b0bb67-74c8-44fd-96d5-965b827dcb20 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:18.122200 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-05b0bb67-74c8-44fd-96d5-965b827dcb20 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:18.128648 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-05b0bb67-74c8-44fd-96d5-965b827dcb20 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:18.129139 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-05b0bb67-74c8-44fd-96d5-965b827dcb20 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:18.129624 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-05b0bb67-74c8-44fd-96d5-965b827dcb20 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:18.130256 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-05b0bb67-74c8-44fd-96d5-965b827dcb20 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:18.130778 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-05b0bb67-74c8-44fd-96d5-965b827dcb20 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:18.131194 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-05b0bb67-74c8-44fd-96d5-965b827dcb20 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:18.264417 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-05b0bb67-74c8-44fd-96d5-965b827dcb20 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:12:18.272184 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-05b0bb67-74c8-44fd-96d5-965b827dcb20 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1512 microversion: 2.1 time: 0.155139 Sep 15 13:12:18.273052 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 547/1080] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:12:18 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:12:18.370631 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-146f718d-7ff3-4a52-bf6c-779460ebdd63 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:18.371250 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-146f718d-7ff3-4a52-bf6c-779460ebdd63 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:18.377536 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-146f718d-7ff3-4a52-bf6c-779460ebdd63 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:18.378015 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-146f718d-7ff3-4a52-bf6c-779460ebdd63 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:18.378443 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-146f718d-7ff3-4a52-bf6c-779460ebdd63 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:18.379121 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-146f718d-7ff3-4a52-bf6c-779460ebdd63 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:18.379571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-146f718d-7ff3-4a52-bf6c-779460ebdd63 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:18.379989 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-146f718d-7ff3-4a52-bf6c-779460ebdd63 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:18.410549 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-146f718d-7ff3-4a52-bf6c-779460ebdd63 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:18.411021 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-146f718d-7ff3-4a52-bf6c-779460ebdd63 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:18.411453 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-146f718d-7ff3-4a52-bf6c-779460ebdd63 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:18.412528 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-146f718d-7ff3-4a52-bf6c-779460ebdd63 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lazy-loading 'fault' on Instance uuid d6fe9060-6085-4ae1-90d1-dc0ed730c243 {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:12:18.453225 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-146f718d-7ff3-4a52-bf6c-779460ebdd63 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:12:18.460957 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-146f718d-7ff3-4a52-bf6c-779460ebdd63 tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1348 microversion: 2.1 time: 0.095644 Sep 15 13:12:18.461525 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 534/1081] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:12:18 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:12:19.295246 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c1c42635-39ee-4e68-884f-de61a450101b tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:19.295886 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-c1c42635-39ee-4e68-884f-de61a450101b tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:19.302285 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c1c42635-39ee-4e68-884f-de61a450101b tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:19.303670 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c1c42635-39ee-4e68-884f-de61a450101b tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:19.304107 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c1c42635-39ee-4e68-884f-de61a450101b tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:19.304826 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c1c42635-39ee-4e68-884f-de61a450101b tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:19.305274 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c1c42635-39ee-4e68-884f-de61a450101b tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:19.305693 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c1c42635-39ee-4e68-884f-de61a450101b tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:19.435033 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-c1c42635-39ee-4e68-884f-de61a450101b tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:12:19.442699 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c1c42635-39ee-4e68-884f-de61a450101b tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1512 microversion: 2.1 time: 0.151364 Sep 15 13:12:19.443314 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 548/1082] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:12:19 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:12:19.484281 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2cf05716-ca74-40a7-bed4-336ba01eefbc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:19.484907 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2cf05716-ca74-40a7-bed4-336ba01eefbc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:19.491629 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2cf05716-ca74-40a7-bed4-336ba01eefbc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:19.492128 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2cf05716-ca74-40a7-bed4-336ba01eefbc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:19.492607 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2cf05716-ca74-40a7-bed4-336ba01eefbc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:19.493347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2cf05716-ca74-40a7-bed4-336ba01eefbc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:19.493810 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2cf05716-ca74-40a7-bed4-336ba01eefbc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:19.494267 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2cf05716-ca74-40a7-bed4-336ba01eefbc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:19.524318 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2cf05716-ca74-40a7-bed4-336ba01eefbc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:19.524803 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2cf05716-ca74-40a7-bed4-336ba01eefbc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:19.525240 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2cf05716-ca74-40a7-bed4-336ba01eefbc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:19.525683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.objects.instance [None req-2cf05716-ca74-40a7-bed4-336ba01eefbc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lazy-loading 'fault' on Instance uuid d6fe9060-6085-4ae1-90d1-dc0ed730c243 {{(pid=120634) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:12:19.565033 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2cf05716-ca74-40a7-bed4-336ba01eefbc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd09d576051f4b98a8a9b3ec0ca18bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b815e753bbe4a54942550a564653fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:12:19.572832 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2cf05716-ca74-40a7-bed4-336ba01eefbc tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 200 len: 1348 microversion: 2.1 time: 0.092393 Sep 15 13:12:19.573404 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 535/1083] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:12:19 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 1348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:12:20.465963 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-14d5c7d3-f3b3-44d0-8f50-87296355d765 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:20.466576 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-14d5c7d3-f3b3-44d0-8f50-87296355d765 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:20.472950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-14d5c7d3-f3b3-44d0-8f50-87296355d765 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:20.473433 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-14d5c7d3-f3b3-44d0-8f50-87296355d765 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:20.473863 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-14d5c7d3-f3b3-44d0-8f50-87296355d765 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:20.475305 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-14d5c7d3-f3b3-44d0-8f50-87296355d765 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:20.475451 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-14d5c7d3-f3b3-44d0-8f50-87296355d765 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:20.475868 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-14d5c7d3-f3b3-44d0-8f50-87296355d765 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:20.598169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8f9983ae-5a50-4443-b33e-000d85747b8b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:20.598790 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-8f9983ae-5a50-4443-b33e-000d85747b8b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] [instance: d6fe9060-6085-4ae1-90d1-dc0ed730c243] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:20.606527 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8f9983ae-5a50-4443-b33e-000d85747b8b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:20.607252 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8f9983ae-5a50-4443-b33e-000d85747b8b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:20.607696 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8f9983ae-5a50-4443-b33e-000d85747b8b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:20.608384 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-14d5c7d3-f3b3-44d0-8f50-87296355d765 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce1e64fa924abeb7a1e5292a3ca96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d04252e755e423eaf19e824f1c8c516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:12:20.608521 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8f9983ae-5a50-4443-b33e-000d85747b8b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:20.608864 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8f9983ae-5a50-4443-b33e-000d85747b8b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:20.609320 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-8f9983ae-5a50-4443-b33e-000d85747b8b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:20.618108 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-14d5c7d3-f3b3-44d0-8f50-87296355d765 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 200 len: 1512 microversion: 2.1 time: 0.155963 Sep 15 13:12:20.619069 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 549/1084] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:12:20 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:12:20.624682 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-8f9983ae-5a50-4443-b33e-000d85747b8b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] HTTP exception thrown: Instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 could not be found. Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8f9983ae-5a50-4443-b33e-000d85747b8b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Request method failure captured: Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 HTTP/1.1 Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyO-3O1G6tRYhrR_n-2PrjJLvyKUuV35Kg1kj_nHn834EauOHq85HSAweQUzBzfi5PrJAkni1pqny_K6Y_BfAHA6eeQI5aOc9pr1R5AUWfeat4Sgr4iRcug9aN96z-3VergXaUcZ9W832hIBToM5mk3rZxEJ6VT_sL15J2F-a6AHA4Q Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 8b815e753bbe4a54942550a564653fd8 Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-TestMinimumBasicScenario-293295252 Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:12:20.628245 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:12:20.629757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8b815e753bbe4a54942550a564653fd8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8b815e753bbe4a54942550a564653fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8b815e753bbe4a54942550a564653fd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8b815e753bbe4a54942550a564653fd8"}]}] Sep 15 13:12:20.629757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-TestMinimumBasicScenario-293295252 Sep 15 13:12:20.629757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 8b815e753bbe4a54942550a564653fd8 Sep 15 13:12:20.629757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-TestMinimumBasicScenario-293295252 Sep 15 13:12:20.629757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-TestMinimumBasicScenario-293295252-project Sep 15 13:12:20.629757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:12:20.629757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:12:20.629757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: fd09d576051f4b98a8a9b3ec0ca18bc8 Sep 15 13:12:20.629757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-TestMinimumBasicScenario-293295252-project Sep 15 13:12:20.629757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:12:20.629757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 could not be found. Sep 15 13:12:20.629757 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': 'd6fe9060-6085-4ae1-90d1-dc0ed730c243'} Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 could not be found. Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:12:20.631187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 could not be found. Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 could not be found. Sep 15 13:12:20.632787 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:12:20.635309 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-8f9983ae-5a50-4443-b33e-000d85747b8b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Returning 404 to user: Instance d6fe9060-6085-4ae1-90d1-dc0ed730c243 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:12:20.636376 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-8f9983ae-5a50-4443-b33e-000d85747b8b tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243" status: 404 len: 111 microversion: 2.1 time: 0.044322 Sep 15 13:12:20.636754 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 536/1085] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:12:20 2022] GET /compute/v2.1/servers/d6fe9060-6085-4ae1-90d1-dc0ed730c243 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:12:20.644860 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-39af95af-a129-469b-b2d6-1a9527a5de5a tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] Calling method '.version_select at 0x7f62c55cf5e0>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:20.664667 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-39af95af-a129-469b-b2d6-1a9527a5de5a tempest-TestMinimumBasicScenario-293295252 tempest-TestMinimumBasicScenario-293295252-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2034720126" status: 202 len: 0 microversion: 2.1 time: 0.023498 Sep 15 13:12:20.665649 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 550/1086] 10.222.0.57 () {58 vars in 1272 bytes} [Thu Sep 15 13:12:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2034720126 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 13:12:20.920177 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-956fb4b1-46d4-4bb9-aad8-b5f38f2929e1 req-9eb8b94e-13dc-4911-b881-5effb1d54136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8", "name": "network-vif-deleted", "tag": "58439e37-eefc-4a8c-9760-e461eec28bbb"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:12:20.931107 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-956fb4b1-46d4-4bb9-aad8-b5f38f2929e1 req-9eb8b94e-13dc-4911-b881-5effb1d54136 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:20.931590 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-956fb4b1-46d4-4bb9-aad8-b5f38f2929e1 req-9eb8b94e-13dc-4911-b881-5effb1d54136 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:20.932022 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-956fb4b1-46d4-4bb9-aad8-b5f38f2929e1 req-9eb8b94e-13dc-4911-b881-5effb1d54136 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:20.950919 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-956fb4b1-46d4-4bb9-aad8-b5f38f2929e1 req-9eb8b94e-13dc-4911-b881-5effb1d54136 service nova] Creating event network-vif-deleted:58439e37-eefc-4a8c-9760-e461eec28bbb for instance bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 on hv-cinder-83608 Sep 15 13:12:20.957200 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-956fb4b1-46d4-4bb9-aad8-b5f38f2929e1 req-9eb8b94e-13dc-4911-b881-5effb1d54136 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040393 Sep 15 13:12:20.957970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 537/1087] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:12:21.642782 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d5b219d4-6d03-4445-97ea-9b377d44cb67 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:12:21.643346 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d5b219d4-6d03-4445-97ea-9b377d44cb67 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] [instance: bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:12:21.650736 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d5b219d4-6d03-4445-97ea-9b377d44cb67 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:21.651297 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d5b219d4-6d03-4445-97ea-9b377d44cb67 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:21.651756 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d5b219d4-6d03-4445-97ea-9b377d44cb67 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:21.652484 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d5b219d4-6d03-4445-97ea-9b377d44cb67 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:12:21.652937 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d5b219d4-6d03-4445-97ea-9b377d44cb67 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:12:21.653376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d5b219d4-6d03-4445-97ea-9b377d44cb67 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:12:21.666718 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-d5b219d4-6d03-4445-97ea-9b377d44cb67 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] HTTP exception thrown: Instance bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 could not be found. Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d5b219d4-6d03-4445-97ea-9b377d44cb67 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Request method failure captured: Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 HTTP/1.1 Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyQxz0TdkLiUT3nLWzDZeqLrRDJCw3vSFn7ut56tz4B49pReXWnguwalnKKkYzHWxSQ5kgxQwHKTTtpoNKsiIz6MvFxaPFQwIoRJGoMMfSj6e2st2oamEcwusL5y3OTTvEX-Bh7nHYuTSxY2cxhJIvIUfpDkARW-0nAloEAs76uvdU0 Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 9d04252e755e423eaf19e824f1c8c516 Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-VolumesSnapshotTestJSON-801865197 Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:12:21.668432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:12:21.669903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9d04252e755e423eaf19e824f1c8c516", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d04252e755e423eaf19e824f1c8c516"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9d04252e755e423eaf19e824f1c8c516"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9d04252e755e423eaf19e824f1c8c516"}]}] Sep 15 13:12:21.669903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-VolumesSnapshotTestJSON-801865197 Sep 15 13:12:21.669903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 9d04252e755e423eaf19e824f1c8c516 Sep 15 13:12:21.669903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-801865197 Sep 15 13:12:21.669903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-VolumesSnapshotTestJSON-801865197-project Sep 15 13:12:21.669903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:12:21.669903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:12:21.669903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: b4ce1e64fa924abeb7a1e5292a3ca96a Sep 15 13:12:21.669903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-VolumesSnapshotTestJSON-801865197-project Sep 15 13:12:21.669903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:12:21.669903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 could not be found. Sep 15 13:12:21.669903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': 'bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8'} Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 could not be found. Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:12:21.670723 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 could not be found. Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 could not be found. Sep 15 13:12:21.672067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:12:21.673278 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d5b219d4-6d03-4445-97ea-9b377d44cb67 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] Returning 404 to user: Instance bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:12:21.673278 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d5b219d4-6d03-4445-97ea-9b377d44cb67 tempest-VolumesSnapshotTestJSON-801865197 tempest-VolumesSnapshotTestJSON-801865197-project] 10.222.0.57 "GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8" status: 404 len: 111 microversion: 2.1 time: 0.031573 Sep 15 13:12:21.673278 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 551/1088] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:12:21 2022] GET /compute/v2.1/servers/bb61e131-e0f7-4b5b-8c5d-ba9102b36ac8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:14:21.058254 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR oslo.messaging._drivers.impl_rabbit [-] [859cbc54-6cda-4cac-8ba0-40f2918f7359] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 13:14:21.059307 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:14:21.060065 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:14:21.060883 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 13:14:21.061044 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Thu Sep 15 13:14:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 (ip 10.222.0.57) !!! Sep 15 13:14:21.062453 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 15 13:14:21.062599 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Thu Sep 15 13:14:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 (ip 10.222.0.57) !!! Sep 15 13:14:21.067418 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2f5568a9-d6c3-4497-81ad-7f93fec80422 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:21.068621 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2f5568a9-d6c3-4497-81ad-7f93fec80422 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:21.079917 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2f5568a9-d6c3-4497-81ad-7f93fec80422 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:21.080435 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2f5568a9-d6c3-4497-81ad-7f93fec80422 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:21.080880 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2f5568a9-d6c3-4497-81ad-7f93fec80422 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:21.081583 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2f5568a9-d6c3-4497-81ad-7f93fec80422 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:21.082043 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2f5568a9-d6c3-4497-81ad-7f93fec80422 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:21.082474 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2f5568a9-d6c3-4497-81ad-7f93fec80422 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:21.110094 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2f5568a9-d6c3-4497-81ad-7f93fec80422 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Going to try to terminate instance {{(pid=120634) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:14:21.186290 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2f5568a9-d6c3-4497-81ad-7f93fec80422 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 204 len: 0 microversion: 2.1 time: 0.129721 Sep 15 13:14:21.186976 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 538/1089] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:14:21 2022] DELETE /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:14:21.193276 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:14:21.195322 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=60 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:14:21.196801 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 15 13:14:21.196940 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Thu Sep 15 13:14:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 (ip 10.222.0.57) !!! Sep 15 13:14:21.198241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 13:14:21.198395 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Thu Sep 15 13:14:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 (ip 10.222.0.57) !!! Sep 15 13:14:21.202919 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-def56e3d-1c63-48d1-bf99-643ca2810f2a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:21.203534 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-def56e3d-1c63-48d1-bf99-643ca2810f2a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:21.214677 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-def56e3d-1c63-48d1-bf99-643ca2810f2a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:21.215164 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-def56e3d-1c63-48d1-bf99-643ca2810f2a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:21.215601 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-def56e3d-1c63-48d1-bf99-643ca2810f2a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:21.216322 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-def56e3d-1c63-48d1-bf99-643ca2810f2a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:21.216780 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-def56e3d-1c63-48d1-bf99-643ca2810f2a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:21.217207 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-def56e3d-1c63-48d1-bf99-643ca2810f2a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:21.544841 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-def56e3d-1c63-48d1-bf99-643ca2810f2a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:21.552551 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-def56e3d-1c63-48d1-bf99-643ca2810f2a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1578 microversion: 2.1 time: 0.361243 Sep 15 13:14:21.553113 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 552/1090] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:21 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1578 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:14:22.576911 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-cd62d9e1-a7d9-4fa8-9192-ed72453e49b4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:22.578329 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-cd62d9e1-a7d9-4fa8-9192-ed72453e49b4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:22.586960 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cd62d9e1-a7d9-4fa8-9192-ed72453e49b4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:22.587708 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cd62d9e1-a7d9-4fa8-9192-ed72453e49b4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:22.588403 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cd62d9e1-a7d9-4fa8-9192-ed72453e49b4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:22.589287 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cd62d9e1-a7d9-4fa8-9192-ed72453e49b4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:22.589852 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cd62d9e1-a7d9-4fa8-9192-ed72453e49b4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:22.590581 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cd62d9e1-a7d9-4fa8-9192-ed72453e49b4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:22.598042 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO oslo.messaging._drivers.impl_rabbit [-] [859cbc54-6cda-4cac-8ba0-40f2918f7359] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 49802. Sep 15 13:14:22.782246 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-cd62d9e1-a7d9-4fa8-9192-ed72453e49b4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:22.790839 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-cd62d9e1-a7d9-4fa8-9192-ed72453e49b4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1578 microversion: 2.1 time: 0.218409 Sep 15 13:14:22.791409 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 539/1091] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:22 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1578 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:23.814212 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7d3d9781-ad55-481e-9805-3a731afe8ea0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:23.814867 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-7d3d9781-ad55-481e-9805-3a731afe8ea0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:23.821473 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7d3d9781-ad55-481e-9805-3a731afe8ea0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:23.821903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7d3d9781-ad55-481e-9805-3a731afe8ea0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:23.822340 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7d3d9781-ad55-481e-9805-3a731afe8ea0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:23.823045 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7d3d9781-ad55-481e-9805-3a731afe8ea0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:23.823507 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7d3d9781-ad55-481e-9805-3a731afe8ea0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:23.823936 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-7d3d9781-ad55-481e-9805-3a731afe8ea0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:23.901829 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-7d3d9781-ad55-481e-9805-3a731afe8ea0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:23.911035 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7d3d9781-ad55-481e-9805-3a731afe8ea0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1510 microversion: 2.1 time: 0.100684 Sep 15 13:14:23.911620 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 553/1092] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:23 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1510 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:24.243361 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-9de57770-1410-46fe-91ba-b0be559de6e9 req-c42d1b75-4272-47c4-86fe-84e9def07317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f2714f-b4cf-431b-b172-22bb4feb5e27", "name": "network-vif-deleted", "tag": "93e2cbdf-d2a6-4d91-93d8-dead8f9bc2b6"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:14:24.255929 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-9de57770-1410-46fe-91ba-b0be559de6e9 req-c42d1b75-4272-47c4-86fe-84e9def07317 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:24.256448 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-9de57770-1410-46fe-91ba-b0be559de6e9 req-c42d1b75-4272-47c4-86fe-84e9def07317 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:24.257027 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-9de57770-1410-46fe-91ba-b0be559de6e9 req-c42d1b75-4272-47c4-86fe-84e9def07317 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:24.269139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-9de57770-1410-46fe-91ba-b0be559de6e9 req-c42d1b75-4272-47c4-86fe-84e9def07317 service nova] Creating event network-vif-deleted:93e2cbdf-d2a6-4d91-93d8-dead8f9bc2b6 for instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 on hv-cinder-83608 Sep 15 13:14:24.275184 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-9de57770-1410-46fe-91ba-b0be559de6e9 req-c42d1b75-4272-47c4-86fe-84e9def07317 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105986 Sep 15 13:14:24.276173 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 540/1093] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:14:24.935827 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-46eab69f-cc23-4e0b-b7fb-1f457c360a26 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:24.936614 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-46eab69f-cc23-4e0b-b7fb-1f457c360a26 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:24.943485 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46eab69f-cc23-4e0b-b7fb-1f457c360a26 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:24.943977 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46eab69f-cc23-4e0b-b7fb-1f457c360a26 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:24.945038 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46eab69f-cc23-4e0b-b7fb-1f457c360a26 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:24.946201 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46eab69f-cc23-4e0b-b7fb-1f457c360a26 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:24.946661 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46eab69f-cc23-4e0b-b7fb-1f457c360a26 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:24.947086 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46eab69f-cc23-4e0b-b7fb-1f457c360a26 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:24.983978 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46eab69f-cc23-4e0b-b7fb-1f457c360a26 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:24.984497 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46eab69f-cc23-4e0b-b7fb-1f457c360a26 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:24.984935 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-46eab69f-cc23-4e0b-b7fb-1f457c360a26 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:24.985381 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.objects.instance [None req-46eab69f-cc23-4e0b-b7fb-1f457c360a26 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lazy-loading 'fault' on Instance uuid b1f2714f-b4cf-431b-b172-22bb4feb5e27 {{(pid=120633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 13:14:25.028531 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-46eab69f-cc23-4e0b-b7fb-1f457c360a26 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:25.036864 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-46eab69f-cc23-4e0b-b7fb-1f457c360a26 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 200 len: 1229 microversion: 2.1 time: 0.105137 Sep 15 13:14:25.037927 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 554/1094] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:24 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:26.062685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6b8122b1-704b-489b-9c3e-7ff798467f82 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:26.063312 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6b8122b1-704b-489b-9c3e-7ff798467f82 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:26.069773 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b8122b1-704b-489b-9c3e-7ff798467f82 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:26.070258 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b8122b1-704b-489b-9c3e-7ff798467f82 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:26.070723 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b8122b1-704b-489b-9c3e-7ff798467f82 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:26.071419 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b8122b1-704b-489b-9c3e-7ff798467f82 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:26.071870 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b8122b1-704b-489b-9c3e-7ff798467f82 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:26.072321 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-6b8122b1-704b-489b-9c3e-7ff798467f82 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:26.088778 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-6b8122b1-704b-489b-9c3e-7ff798467f82 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] HTTP exception thrown: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6b8122b1-704b-489b-9c3e-7ff798467f82 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Request method failure captured: Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 HTTP/1.1 Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyRMUVNlLRRtwwB9SaJ5mowtx-Rg-ErQ6MovWaRc0yjHvO0_c-uH8sXsZHtHF86ve6FGWjlpZe0NOo-9apr8wFLdzKJd83lB0Z1Tp9tk2ZPeqHacORgslE3uBd2ypc0bCu9YH_yR9QuF298m_ngk5NmivI01k4kaWBlGI53uo7ejN8k Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 1344373f29a44b7c8db2f9bab5f38467 Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:14:26.090424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:14:26.092169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1344373f29a44b7c8db2f9bab5f38467", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1344373f29a44b7c8db2f9bab5f38467"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1344373f29a44b7c8db2f9bab5f38467"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1344373f29a44b7c8db2f9bab5f38467"}]}] Sep 15 13:14:26.092169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:14:26.092169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 1344373f29a44b7c8db2f9bab5f38467 Sep 15 13:14:26.092169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:14:26.092169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-TestVolumeBootPattern-1560206344-project Sep 15 13:14:26.092169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:14:26.092169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:14:26.092169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: 3c50430b23404745ab4c1099bf12d4f5 Sep 15 13:14:26.092169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-TestVolumeBootPattern-1560206344-project Sep 15 13:14:26.092169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:14:26.092169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:14:26.092169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': 'b1f2714f-b4cf-431b-b172-22bb4feb5e27'} Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:14:26.093998 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:14:26.096238 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:14:26.098151 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6b8122b1-704b-489b-9c3e-7ff798467f82 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Returning 404 to user: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:14:26.098151 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6b8122b1-704b-489b-9c3e-7ff798467f82 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 404 len: 111 microversion: 2.1 time: 0.034748 Sep 15 13:14:26.098151 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 541/1095] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:26 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:14:26.195744 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1110433818", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-637497301", "security_groups": [{"name": "tempest-secgroup-smoke-1018743802"}], "block_device_mapping_v2": [{"uuid": "0e102f8f-6323-4f91-9bad-e448eda6e544", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "557bdd31-96bd-482d-9ed9-43fcea7b78d7"}]}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:14:26.309708 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.network.neutron [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] validate_networks() for [('557bdd31-96bd-482d-9ed9-43fcea7b78d7', None, None, None, None, None)] {{(pid=120633) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:14:26.673634 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Flavor limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:14:26.674058 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Image limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:14:26.674534 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Flavor pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:14:26.674943 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Image pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:14:26.675354 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:14:26.684809 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:26.685291 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:26.685726 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:26.686452 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:26.686906 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:26.687331 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:26.703768 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Getting quotas for project 1344373f29a44b7c8db2f9bab5f38467. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:14:26.707694 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Getting quotas for user 3c50430b23404745ab4c1099bf12d4f5 and project 1344373f29a44b7c8db2f9bab5f38467. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:14:26.763867 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Going to run 1 instances... {{(pid=120633) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:14:26.766010 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e102f8f-6323-4f91-9bad-e448eda6e544',volume_size=None,volume_type=None)] {{(pid=120633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:14:26.892833 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9160524b-ea2d-4a5d-9d00-9642546d170c tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.701173 Sep 15 13:14:26.893792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 555/1096] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:14:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 13:14:26.905714 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5e20080e-530c-4704-99dc-752c755e6496 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:26.906333 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5e20080e-530c-4704-99dc-752c755e6496 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:26.965649 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5e20080e-530c-4704-99dc-752c755e6496 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:26.972554 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5e20080e-530c-4704-99dc-752c755e6496 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1094 microversion: 2.1 time: 0.070995 Sep 15 13:14:26.973131 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 542/1097] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:26 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:27.996115 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e8294e37-020a-4a1f-8972-e9cb01689fc9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:27.996679 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-e8294e37-020a-4a1f-8972-e9cb01689fc9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:28.004216 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e8294e37-020a-4a1f-8972-e9cb01689fc9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:28.004764 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e8294e37-020a-4a1f-8972-e9cb01689fc9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:28.005197 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e8294e37-020a-4a1f-8972-e9cb01689fc9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:28.005903 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e8294e37-020a-4a1f-8972-e9cb01689fc9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:28.006351 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e8294e37-020a-4a1f-8972-e9cb01689fc9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:28.007423 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e8294e37-020a-4a1f-8972-e9cb01689fc9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:28.070525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-e8294e37-020a-4a1f-8972-e9cb01689fc9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:28.078270 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e8294e37-020a-4a1f-8972-e9cb01689fc9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1210 microversion: 2.1 time: 0.086548 Sep 15 13:14:28.078838 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 556/1098] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:27 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:29.105770 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-26fc15e0-a53b-4918-8c20-44188b128748 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:29.106383 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-26fc15e0-a53b-4918-8c20-44188b128748 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:29.113985 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-26fc15e0-a53b-4918-8c20-44188b128748 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:29.114462 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-26fc15e0-a53b-4918-8c20-44188b128748 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:29.114895 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-26fc15e0-a53b-4918-8c20-44188b128748 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:29.116502 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-26fc15e0-a53b-4918-8c20-44188b128748 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:29.116957 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-26fc15e0-a53b-4918-8c20-44188b128748 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:29.117455 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-26fc15e0-a53b-4918-8c20-44188b128748 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:29.311156 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-26fc15e0-a53b-4918-8c20-44188b128748 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:29.318882 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-26fc15e0-a53b-4918-8c20-44188b128748 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1266 microversion: 2.1 time: 0.217042 Sep 15 13:14:29.320002 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 543/1099] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:29 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:14:29.443614 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-e1cf6798-9443-46cd-9c0b-22b7da32f6a7 req-2e88a4f8-c845-4c9c-8dfd-4149582ebd99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26b9d622-cc02-41bb-be21-da138c80ba36", "tag": "5f2b06e0-044d-47fc-9990-00ba28ee8a35"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:14:29.454758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e1cf6798-9443-46cd-9c0b-22b7da32f6a7 req-2e88a4f8-c845-4c9c-8dfd-4149582ebd99 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:29.455331 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e1cf6798-9443-46cd-9c0b-22b7da32f6a7 req-2e88a4f8-c845-4c9c-8dfd-4149582ebd99 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:29.455826 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-e1cf6798-9443-46cd-9c0b-22b7da32f6a7 req-2e88a4f8-c845-4c9c-8dfd-4149582ebd99 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:29.467416 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-e1cf6798-9443-46cd-9c0b-22b7da32f6a7 req-2e88a4f8-c845-4c9c-8dfd-4149582ebd99 service nova] Creating event network-changed:5f2b06e0-044d-47fc-9990-00ba28ee8a35 for instance 26b9d622-cc02-41bb-be21-da138c80ba36 on hv-cinder-83608 Sep 15 13:14:29.473243 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-e1cf6798-9443-46cd-9c0b-22b7da32f6a7 req-2e88a4f8-c845-4c9c-8dfd-4149582ebd99 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033428 Sep 15 13:14:29.473774 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 557/1100] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:14:30.342666 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-9e5bdfb0-3e01-4d73-9d17-488c79bc0bc6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:30.343276 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-9e5bdfb0-3e01-4d73-9d17-488c79bc0bc6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:30.349726 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9e5bdfb0-3e01-4d73-9d17-488c79bc0bc6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:30.350151 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9e5bdfb0-3e01-4d73-9d17-488c79bc0bc6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:30.350838 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9e5bdfb0-3e01-4d73-9d17-488c79bc0bc6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:30.351545 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9e5bdfb0-3e01-4d73-9d17-488c79bc0bc6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:30.351996 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9e5bdfb0-3e01-4d73-9d17-488c79bc0bc6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:30.352454 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-9e5bdfb0-3e01-4d73-9d17-488c79bc0bc6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:30.484403 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-9e5bdfb0-3e01-4d73-9d17-488c79bc0bc6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:30.492690 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-9e5bdfb0-3e01-4d73-9d17-488c79bc0bc6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1266 microversion: 2.1 time: 0.153905 Sep 15 13:14:30.493252 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 544/1101] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:30 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:31.516242 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-51fde68b-0e7c-41ff-80d8-145a694d92a1 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:31.516985 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-51fde68b-0e7c-41ff-80d8-145a694d92a1 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:31.523073 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-51fde68b-0e7c-41ff-80d8-145a694d92a1 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:31.523814 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-51fde68b-0e7c-41ff-80d8-145a694d92a1 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:31.524250 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-51fde68b-0e7c-41ff-80d8-145a694d92a1 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:31.524961 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-51fde68b-0e7c-41ff-80d8-145a694d92a1 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:31.525416 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-51fde68b-0e7c-41ff-80d8-145a694d92a1 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:31.525840 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-51fde68b-0e7c-41ff-80d8-145a694d92a1 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:31.661569 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-51fde68b-0e7c-41ff-80d8-145a694d92a1 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:31.669381 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-51fde68b-0e7c-41ff-80d8-145a694d92a1 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1266 microversion: 2.1 time: 0.157907 Sep 15 13:14:31.669945 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 558/1102] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:31 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:32.692466 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-dfce16a8-29ad-406c-88c6-2338fb1f1c3d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:32.693105 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-dfce16a8-29ad-406c-88c6-2338fb1f1c3d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:32.700093 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dfce16a8-29ad-406c-88c6-2338fb1f1c3d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:32.700601 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dfce16a8-29ad-406c-88c6-2338fb1f1c3d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:32.701033 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dfce16a8-29ad-406c-88c6-2338fb1f1c3d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:32.701722 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dfce16a8-29ad-406c-88c6-2338fb1f1c3d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:32.702170 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dfce16a8-29ad-406c-88c6-2338fb1f1c3d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:32.702587 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-dfce16a8-29ad-406c-88c6-2338fb1f1c3d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:32.831152 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-dfce16a8-29ad-406c-88c6-2338fb1f1c3d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:32.839503 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-dfce16a8-29ad-406c-88c6-2338fb1f1c3d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1266 microversion: 2.1 time: 0.150919 Sep 15 13:14:32.840072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 545/1103] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:32 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:33.862067 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-9732ad1c-1255-443b-a957-419ef43612b3 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:33.862683 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-9732ad1c-1255-443b-a957-419ef43612b3 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:33.870078 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9732ad1c-1255-443b-a957-419ef43612b3 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:33.870713 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9732ad1c-1255-443b-a957-419ef43612b3 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:33.871152 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9732ad1c-1255-443b-a957-419ef43612b3 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:33.871847 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9732ad1c-1255-443b-a957-419ef43612b3 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:33.872325 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9732ad1c-1255-443b-a957-419ef43612b3 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:33.872752 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-9732ad1c-1255-443b-a957-419ef43612b3 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:34.001900 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-9732ad1c-1255-443b-a957-419ef43612b3 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:34.010001 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-9732ad1c-1255-443b-a957-419ef43612b3 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1266 microversion: 2.1 time: 0.151836 Sep 15 13:14:34.010563 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 559/1104] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:33 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:35.033688 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-60d98210-00f9-4d15-a804-10904f0dc9e5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:35.034293 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-60d98210-00f9-4d15-a804-10904f0dc9e5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:35.040867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-60d98210-00f9-4d15-a804-10904f0dc9e5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:35.041352 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-60d98210-00f9-4d15-a804-10904f0dc9e5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:35.041814 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-60d98210-00f9-4d15-a804-10904f0dc9e5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:35.042503 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-60d98210-00f9-4d15-a804-10904f0dc9e5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:35.042954 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-60d98210-00f9-4d15-a804-10904f0dc9e5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:35.043369 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-60d98210-00f9-4d15-a804-10904f0dc9e5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:35.175923 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-60d98210-00f9-4d15-a804-10904f0dc9e5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:35.184121 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-60d98210-00f9-4d15-a804-10904f0dc9e5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1266 microversion: 2.1 time: 0.154356 Sep 15 13:14:35.184725 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 546/1105] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:35 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:36.207130 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0de46e32-e869-499a-957c-0381fc8e97a2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:36.207741 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-0de46e32-e869-499a-957c-0381fc8e97a2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:36.214432 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0de46e32-e869-499a-957c-0381fc8e97a2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:36.214942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0de46e32-e869-499a-957c-0381fc8e97a2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:36.215376 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0de46e32-e869-499a-957c-0381fc8e97a2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:36.216073 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0de46e32-e869-499a-957c-0381fc8e97a2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:36.216543 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0de46e32-e869-499a-957c-0381fc8e97a2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:36.216966 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-0de46e32-e869-499a-957c-0381fc8e97a2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:36.349177 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-0de46e32-e869-499a-957c-0381fc8e97a2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:36.357326 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0de46e32-e869-499a-957c-0381fc8e97a2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1266 microversion: 2.1 time: 0.154086 Sep 15 13:14:36.357892 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 560/1106] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:36 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:37.379282 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5be6bb73-42dc-4dd5-b9dd-c0a7848d60a5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:37.379893 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5be6bb73-42dc-4dd5-b9dd-c0a7848d60a5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:37.383001 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:14:37.388422 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5be6bb73-42dc-4dd5-b9dd-c0a7848d60a5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:37.388913 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5be6bb73-42dc-4dd5-b9dd-c0a7848d60a5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:37.389348 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5be6bb73-42dc-4dd5-b9dd-c0a7848d60a5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:37.390038 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5be6bb73-42dc-4dd5-b9dd-c0a7848d60a5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:37.390489 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5be6bb73-42dc-4dd5-b9dd-c0a7848d60a5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:37.390911 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5be6bb73-42dc-4dd5-b9dd-c0a7848d60a5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:37.526169 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5be6bb73-42dc-4dd5-b9dd-c0a7848d60a5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:37.533816 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5be6bb73-42dc-4dd5-b9dd-c0a7848d60a5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1266 microversion: 2.1 time: 0.158403 Sep 15 13:14:37.534386 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 547/1107] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:37 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:38.557468 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b41d767c-2a03-4d49-9b6e-d6c3b5dfbdee tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:38.558086 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b41d767c-2a03-4d49-9b6e-d6c3b5dfbdee tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:38.560041 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:14:38.560712 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=6 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:14:38.567096 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b41d767c-2a03-4d49-9b6e-d6c3b5dfbdee tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:38.567578 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b41d767c-2a03-4d49-9b6e-d6c3b5dfbdee tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:38.568015 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b41d767c-2a03-4d49-9b6e-d6c3b5dfbdee tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:38.568738 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b41d767c-2a03-4d49-9b6e-d6c3b5dfbdee tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:38.569408 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b41d767c-2a03-4d49-9b6e-d6c3b5dfbdee tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:38.569836 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b41d767c-2a03-4d49-9b6e-d6c3b5dfbdee tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:38.700565 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b41d767c-2a03-4d49-9b6e-d6c3b5dfbdee tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:38.708191 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b41d767c-2a03-4d49-9b6e-d6c3b5dfbdee tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1266 microversion: 2.1 time: 0.155417 Sep 15 13:14:38.708854 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 561/1108] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:38 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:39.732124 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e81bf4a9-3877-438a-af0f-ca3e5fbd458d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:39.732774 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-e81bf4a9-3877-438a-af0f-ca3e5fbd458d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:39.739212 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e81bf4a9-3877-438a-af0f-ca3e5fbd458d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:39.739698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e81bf4a9-3877-438a-af0f-ca3e5fbd458d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:39.740135 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e81bf4a9-3877-438a-af0f-ca3e5fbd458d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:39.740859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e81bf4a9-3877-438a-af0f-ca3e5fbd458d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:39.741314 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e81bf4a9-3877-438a-af0f-ca3e5fbd458d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:39.741731 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-e81bf4a9-3877-438a-af0f-ca3e5fbd458d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:39.882742 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-e81bf4a9-3877-438a-af0f-ca3e5fbd458d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:39.890509 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e81bf4a9-3877-438a-af0f-ca3e5fbd458d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1266 microversion: 2.1 time: 0.162638 Sep 15 13:14:39.891104 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 548/1109] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:39 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:40.307963 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-45f06a29-68ff-480f-9d03-ed75bcc90df0 req-5c5e1713-c621-4342-9ef7-76fcc1268951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b9d622-cc02-41bb-be21-da138c80ba36", "name": "network-vif-plugged", "status": "completed", "tag": "5f2b06e0-044d-47fc-9990-00ba28ee8a35"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:14:40.318035 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-45f06a29-68ff-480f-9d03-ed75bcc90df0 req-5c5e1713-c621-4342-9ef7-76fcc1268951 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:40.318905 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-45f06a29-68ff-480f-9d03-ed75bcc90df0 req-5c5e1713-c621-4342-9ef7-76fcc1268951 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:40.319589 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-45f06a29-68ff-480f-9d03-ed75bcc90df0 req-5c5e1713-c621-4342-9ef7-76fcc1268951 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:40.334098 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-45f06a29-68ff-480f-9d03-ed75bcc90df0 req-5c5e1713-c621-4342-9ef7-76fcc1268951 service nova] Creating event network-vif-plugged:5f2b06e0-044d-47fc-9990-00ba28ee8a35 for instance 26b9d622-cc02-41bb-be21-da138c80ba36 on hv-cinder-83608 Sep 15 13:14:40.339965 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-45f06a29-68ff-480f-9d03-ed75bcc90df0 req-5c5e1713-c621-4342-9ef7-76fcc1268951 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036619 Sep 15 13:14:40.340596 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 562/1110] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:14:40.913639 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2bf39b66-9aba-41b5-9977-a4f5500c169f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:40.914176 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2bf39b66-9aba-41b5-9977-a4f5500c169f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:40.920495 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bf39b66-9aba-41b5-9977-a4f5500c169f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:40.920984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bf39b66-9aba-41b5-9977-a4f5500c169f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:40.921439 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bf39b66-9aba-41b5-9977-a4f5500c169f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:40.922122 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bf39b66-9aba-41b5-9977-a4f5500c169f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:40.922571 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bf39b66-9aba-41b5-9977-a4f5500c169f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:40.922990 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bf39b66-9aba-41b5-9977-a4f5500c169f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:41.051335 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-2bf39b66-9aba-41b5-9977-a4f5500c169f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:41.059104 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2bf39b66-9aba-41b5-9977-a4f5500c169f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1266 microversion: 2.1 time: 0.149596 Sep 15 13:14:41.059669 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 549/1111] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:40 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:42.083368 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-53e297fa-dd91-46a4-b141-223efcddeff7 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:42.084075 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-53e297fa-dd91-46a4-b141-223efcddeff7 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:42.090822 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-53e297fa-dd91-46a4-b141-223efcddeff7 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:42.091304 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-53e297fa-dd91-46a4-b141-223efcddeff7 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:42.091736 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-53e297fa-dd91-46a4-b141-223efcddeff7 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:42.092460 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-53e297fa-dd91-46a4-b141-223efcddeff7 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:42.092915 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-53e297fa-dd91-46a4-b141-223efcddeff7 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:42.093336 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-53e297fa-dd91-46a4-b141-223efcddeff7 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:42.229178 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-53e297fa-dd91-46a4-b141-223efcddeff7 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:42.236807 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-53e297fa-dd91-46a4-b141-223efcddeff7 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1266 microversion: 2.1 time: 0.158139 Sep 15 13:14:42.237386 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 563/1112] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:42 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:43.259321 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-0c0c9c19-9c18-4960-9883-17215e749215 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:43.259939 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-0c0c9c19-9c18-4960-9883-17215e749215 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:43.266448 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0c0c9c19-9c18-4960-9883-17215e749215 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:43.266935 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0c0c9c19-9c18-4960-9883-17215e749215 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:43.267367 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0c0c9c19-9c18-4960-9883-17215e749215 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:43.268056 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0c0c9c19-9c18-4960-9883-17215e749215 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:43.268534 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0c0c9c19-9c18-4960-9883-17215e749215 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:43.268954 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-0c0c9c19-9c18-4960-9883-17215e749215 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:43.401002 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-0c0c9c19-9c18-4960-9883-17215e749215 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:43.408698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-0c0c9c19-9c18-4960-9883-17215e749215 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1454 microversion: 2.1 time: 0.153274 Sep 15 13:14:43.409253 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 550/1113] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:43 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:43.430923 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3d31fc22-7bb4-4f4e-8da8-208fc2d2ffcd tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:14:43.431533 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-3d31fc22-7bb4-4f4e-8da8-208fc2d2ffcd tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:14:43.437880 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3d31fc22-7bb4-4f4e-8da8-208fc2d2ffcd tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:43.438363 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3d31fc22-7bb4-4f4e-8da8-208fc2d2ffcd tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:43.438798 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3d31fc22-7bb4-4f4e-8da8-208fc2d2ffcd tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:43.439484 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3d31fc22-7bb4-4f4e-8da8-208fc2d2ffcd tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:43.439938 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3d31fc22-7bb4-4f4e-8da8-208fc2d2ffcd tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:43.440387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-3d31fc22-7bb4-4f4e-8da8-208fc2d2ffcd tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:43.574274 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-3d31fc22-7bb4-4f4e-8da8-208fc2d2ffcd tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:14:43.581921 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3d31fc22-7bb4-4f4e-8da8-208fc2d2ffcd tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1454 microversion: 2.1 time: 0.154837 Sep 15 13:14:43.582477 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 564/1114] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:14:43 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:14:45.400004 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-94b38261-ff90-4f66-b10c-b6bf651a7bb2 req-9d2abbfb-9346-4733-8075-aac6b58ff1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26b9d622-cc02-41bb-be21-da138c80ba36", "tag": "5f2b06e0-044d-47fc-9990-00ba28ee8a35"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:14:45.410173 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-94b38261-ff90-4f66-b10c-b6bf651a7bb2 req-9d2abbfb-9346-4733-8075-aac6b58ff1a6 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:14:45.410643 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-94b38261-ff90-4f66-b10c-b6bf651a7bb2 req-9d2abbfb-9346-4733-8075-aac6b58ff1a6 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:14:45.411072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-94b38261-ff90-4f66-b10c-b6bf651a7bb2 req-9d2abbfb-9346-4733-8075-aac6b58ff1a6 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:14:45.422424 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-94b38261-ff90-4f66-b10c-b6bf651a7bb2 req-9d2abbfb-9346-4733-8075-aac6b58ff1a6 service nova] Creating event network-changed:5f2b06e0-044d-47fc-9990-00ba28ee8a35 for instance 26b9d622-cc02-41bb-be21-da138c80ba36 on hv-cinder-83608 Sep 15 13:14:45.428192 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-94b38261-ff90-4f66-b10c-b6bf651a7bb2 req-9d2abbfb-9346-4733-8075-aac6b58ff1a6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033391 Sep 15 13:14:45.429098 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 551/1115] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:16:41.932227 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7ad57643-c80f-478c-8e1f-5482a85eb523] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 13:16:41.933047 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:16:41.933763 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=68 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:16:41.934856 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 13:16:41.935011 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Thu Sep 15 13:16:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.57) !!! Sep 15 13:16:41.942249 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-558100407", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-637497301", "security_groups": [{"name": "tempest-secgroup-smoke-1018743802"}], "block_device_mapping_v2": [{"uuid": "1b3cd548-412c-4147-aaff-3dcbb0f777d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "557bdd31-96bd-482d-9ed9-43fcea7b78d7"}]}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:16:42.069495 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.network.neutron [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] validate_networks() for [('557bdd31-96bd-482d-9ed9-43fcea7b78d7', None, None, None, None, None)] {{(pid=120633) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 13:16:42.477891 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Flavor limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 13:16:42.478311 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Image limits 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 13:16:42.478781 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Flavor pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 13:16:42.479187 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Image pref 0:0:0 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 13:16:42.479592 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.virt.hardware [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 13:16:42.488303 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:42.488776 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:42.489209 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:42.489948 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:42.490387 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:42.490811 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:42.507922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Getting quotas for project 1344373f29a44b7c8db2f9bab5f38467. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 13:16:42.511898 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.quota [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Getting quotas for user 3c50430b23404745ab4c1099bf12d4f5 and project 1344373f29a44b7c8db2f9bab5f38467. Resources: {'cores', 'ram', 'instances'} {{(pid=120633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 13:16:42.568837 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Going to run 1 instances... {{(pid=120633) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 13:16:42.570981 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1b3cd548-412c-4147-aaff-3dcbb0f777d8',volume_size=None,volume_type=None)] {{(pid=120633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 13:16:42.701179 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-488e738c-c2d9-47a7-9e07-004d50f3162a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.770701 Sep 15 13:16:42.701828 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 565/1116] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Sep 15 13:16:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 13:16:42.711921 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:16:42.712799 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:16:42.718122 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6f6c4c6f-f948-4fb0-becb-f9fd2356dff9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:42.718733 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-6f6c4c6f-f948-4fb0-becb-f9fd2356dff9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:42.778050 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-6f6c4c6f-f948-4fb0-becb-f9fd2356dff9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:42.785016 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6f6c4c6f-f948-4fb0-becb-f9fd2356dff9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1093 microversion: 2.1 time: 0.075579 Sep 15 13:16:42.785585 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 552/1117] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:42 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:16:43.809449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-51d7a962-4fbb-4ab6-acbf-baa9ca1c0d75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:43.810048 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-51d7a962-4fbb-4ab6-acbf-baa9ca1c0d75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:43.821690 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO oslo.messaging._drivers.impl_rabbit [-] [7ad57643-c80f-478c-8e1f-5482a85eb523] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 49978. Sep 15 13:16:43.825846 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-51d7a962-4fbb-4ab6-acbf-baa9ca1c0d75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:43.826384 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-51d7a962-4fbb-4ab6-acbf-baa9ca1c0d75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:43.826817 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-51d7a962-4fbb-4ab6-acbf-baa9ca1c0d75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:43.828055 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-51d7a962-4fbb-4ab6-acbf-baa9ca1c0d75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:43.828549 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-51d7a962-4fbb-4ab6-acbf-baa9ca1c0d75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:43.828970 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-51d7a962-4fbb-4ab6-acbf-baa9ca1c0d75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:43.894865 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-51d7a962-4fbb-4ab6-acbf-baa9ca1c0d75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:43.904802 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-51d7a962-4fbb-4ab6-acbf-baa9ca1c0d75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1199 microversion: 2.1 time: 0.098825 Sep 15 13:16:43.905203 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 566/1118] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:43 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1199 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:16:44.927009 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a9d80c36-2f86-41e3-9d31-dc0bf877a187 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:44.927662 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a9d80c36-2f86-41e3-9d31-dc0bf877a187 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:44.935736 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a9d80c36-2f86-41e3-9d31-dc0bf877a187 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:44.936229 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a9d80c36-2f86-41e3-9d31-dc0bf877a187 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:44.936694 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a9d80c36-2f86-41e3-9d31-dc0bf877a187 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:44.937393 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a9d80c36-2f86-41e3-9d31-dc0bf877a187 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:44.937851 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a9d80c36-2f86-41e3-9d31-dc0bf877a187 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:44.938277 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a9d80c36-2f86-41e3-9d31-dc0bf877a187 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:45.175297 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a9d80c36-2f86-41e3-9d31-dc0bf877a187 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:45.183327 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a9d80c36-2f86-41e3-9d31-dc0bf877a187 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1265 microversion: 2.1 time: 0.260208 Sep 15 13:16:45.183897 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 553/1119] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:44 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:16:45.366145 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [req-7b1845ca-0c46-4a2c-8160-8248eed6dfcf req-e9936a73-0a2a-4143-bc08-adbc421c069e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c320abb-d68d-42e7-90e8-157f80b078d2", "tag": "aef7fc17-f173-499b-8e4c-e2499cc7875c"}]} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:16:45.377069 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-7b1845ca-0c46-4a2c-8160-8248eed6dfcf req-e9936a73-0a2a-4143-bc08-adbc421c069e service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:45.377554 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-7b1845ca-0c46-4a2c-8160-8248eed6dfcf req-e9936a73-0a2a-4143-bc08-adbc421c069e service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:45.377993 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [req-7b1845ca-0c46-4a2c-8160-8248eed6dfcf req-e9936a73-0a2a-4143-bc08-adbc421c069e service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:45.389838 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.compute.server_external_events [req-7b1845ca-0c46-4a2c-8160-8248eed6dfcf req-e9936a73-0a2a-4143-bc08-adbc421c069e service nova] Creating event network-changed:aef7fc17-f173-499b-8e4c-e2499cc7875c for instance 9c320abb-d68d-42e7-90e8-157f80b078d2 on hv-cinder-83608 Sep 15 13:16:45.394920 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [req-7b1845ca-0c46-4a2c-8160-8248eed6dfcf req-e9936a73-0a2a-4143-bc08-adbc421c069e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032554 Sep 15 13:16:45.395511 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 567/1120] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:16:46.207143 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d75dd46c-a7fb-49a2-ae2d-54138b372731 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:46.207750 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d75dd46c-a7fb-49a2-ae2d-54138b372731 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:46.214620 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d75dd46c-a7fb-49a2-ae2d-54138b372731 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:46.215098 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d75dd46c-a7fb-49a2-ae2d-54138b372731 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:46.215530 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d75dd46c-a7fb-49a2-ae2d-54138b372731 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:46.216216 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d75dd46c-a7fb-49a2-ae2d-54138b372731 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:46.216690 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d75dd46c-a7fb-49a2-ae2d-54138b372731 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:46.217160 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d75dd46c-a7fb-49a2-ae2d-54138b372731 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:46.349099 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d75dd46c-a7fb-49a2-ae2d-54138b372731 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:46.357319 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d75dd46c-a7fb-49a2-ae2d-54138b372731 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1265 microversion: 2.1 time: 0.154112 Sep 15 13:16:46.357885 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 554/1121] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:46 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:16:47.381527 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-18c5e39e-ffde-463a-b2ef-a58eecc7caaf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:47.382154 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-18c5e39e-ffde-463a-b2ef-a58eecc7caaf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:47.388993 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-18c5e39e-ffde-463a-b2ef-a58eecc7caaf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:47.389472 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-18c5e39e-ffde-463a-b2ef-a58eecc7caaf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:47.389910 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-18c5e39e-ffde-463a-b2ef-a58eecc7caaf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:47.390597 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-18c5e39e-ffde-463a-b2ef-a58eecc7caaf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:47.391051 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-18c5e39e-ffde-463a-b2ef-a58eecc7caaf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:47.391474 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-18c5e39e-ffde-463a-b2ef-a58eecc7caaf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:47.530208 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-18c5e39e-ffde-463a-b2ef-a58eecc7caaf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:47.537905 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-18c5e39e-ffde-463a-b2ef-a58eecc7caaf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1265 microversion: 2.1 time: 0.161150 Sep 15 13:16:47.538466 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 568/1122] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:47 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:16:48.560542 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d6c14ddb-5880-45cb-a14c-0dc7e43870d5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:48.561158 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-d6c14ddb-5880-45cb-a14c-0dc7e43870d5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:48.567696 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6c14ddb-5880-45cb-a14c-0dc7e43870d5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:48.568184 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6c14ddb-5880-45cb-a14c-0dc7e43870d5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:48.568650 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6c14ddb-5880-45cb-a14c-0dc7e43870d5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:48.569342 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6c14ddb-5880-45cb-a14c-0dc7e43870d5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:48.569873 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6c14ddb-5880-45cb-a14c-0dc7e43870d5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:48.570378 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-d6c14ddb-5880-45cb-a14c-0dc7e43870d5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:48.699600 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-d6c14ddb-5880-45cb-a14c-0dc7e43870d5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:48.707333 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d6c14ddb-5880-45cb-a14c-0dc7e43870d5 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1265 microversion: 2.1 time: 0.150700 Sep 15 13:16:48.707900 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 555/1123] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:48 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:16:49.729615 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-70f04530-d8fc-40b5-a9c0-ded78ce139a4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:49.730266 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-70f04530-d8fc-40b5-a9c0-ded78ce139a4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:49.736730 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-70f04530-d8fc-40b5-a9c0-ded78ce139a4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:49.737210 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-70f04530-d8fc-40b5-a9c0-ded78ce139a4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:49.737635 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-70f04530-d8fc-40b5-a9c0-ded78ce139a4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:49.738310 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-70f04530-d8fc-40b5-a9c0-ded78ce139a4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:49.738756 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-70f04530-d8fc-40b5-a9c0-ded78ce139a4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:49.739167 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-70f04530-d8fc-40b5-a9c0-ded78ce139a4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:49.867691 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-70f04530-d8fc-40b5-a9c0-ded78ce139a4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:49.875577 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-70f04530-d8fc-40b5-a9c0-ded78ce139a4 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1265 microversion: 2.1 time: 0.150319 Sep 15 13:16:49.882584 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 569/1124] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:49 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:16:50.899430 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a5b3fa97-e159-40bd-9911-861298da141f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:50.900083 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a5b3fa97-e159-40bd-9911-861298da141f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:50.906689 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a5b3fa97-e159-40bd-9911-861298da141f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:50.907187 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a5b3fa97-e159-40bd-9911-861298da141f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:50.907624 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a5b3fa97-e159-40bd-9911-861298da141f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:50.908350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a5b3fa97-e159-40bd-9911-861298da141f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:50.908804 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a5b3fa97-e159-40bd-9911-861298da141f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:50.909225 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a5b3fa97-e159-40bd-9911-861298da141f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:51.079347 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a5b3fa97-e159-40bd-9911-861298da141f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:51.088222 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a5b3fa97-e159-40bd-9911-861298da141f tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1265 microversion: 2.1 time: 0.193082 Sep 15 13:16:51.088858 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 556/1125] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:50 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:16:52.113327 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-61075e98-1daa-4d2c-9f25-e70969776c75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:52.113939 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-61075e98-1daa-4d2c-9f25-e70969776c75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:52.120533 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61075e98-1daa-4d2c-9f25-e70969776c75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:52.121015 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61075e98-1daa-4d2c-9f25-e70969776c75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:52.121450 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61075e98-1daa-4d2c-9f25-e70969776c75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:52.122134 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61075e98-1daa-4d2c-9f25-e70969776c75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:52.122583 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61075e98-1daa-4d2c-9f25-e70969776c75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:52.123004 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-61075e98-1daa-4d2c-9f25-e70969776c75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:52.253172 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-61075e98-1daa-4d2c-9f25-e70969776c75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:52.261309 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-61075e98-1daa-4d2c-9f25-e70969776c75 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1265 microversion: 2.1 time: 0.151959 Sep 15 13:16:52.261865 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 570/1126] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:52 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:16:53.284581 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-cd0e4a28-4f4a-43c9-aa2a-ddfc16d6b10d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:53.285201 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-cd0e4a28-4f4a-43c9-aa2a-ddfc16d6b10d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:53.287487 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell0:SELECT=2 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:16:53.295198 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cd0e4a28-4f4a-43c9-aa2a-ddfc16d6b10d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:53.296090 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cd0e4a28-4f4a-43c9-aa2a-ddfc16d6b10d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:53.296872 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cd0e4a28-4f4a-43c9-aa2a-ddfc16d6b10d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:53.297588 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cd0e4a28-4f4a-43c9-aa2a-ddfc16d6b10d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:53.298189 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cd0e4a28-4f4a-43c9-aa2a-ddfc16d6b10d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:53.298989 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-cd0e4a28-4f4a-43c9-aa2a-ddfc16d6b10d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:53.441473 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-cd0e4a28-4f4a-43c9-aa2a-ddfc16d6b10d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:53.450092 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-cd0e4a28-4f4a-43c9-aa2a-ddfc16d6b10d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1265 microversion: 2.1 time: 0.170020 Sep 15 13:16:53.450666 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 557/1127] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:53 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:16:54.473143 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ac08ec25-df3f-4fe1-9499-7daa8b85e9aa tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:54.473751 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ac08ec25-df3f-4fe1-9499-7daa8b85e9aa tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:54.475695 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=2 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:16:54.476656 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell0:SELECT=6 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:16:54.482853 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ac08ec25-df3f-4fe1-9499-7daa8b85e9aa tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:54.483330 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ac08ec25-df3f-4fe1-9499-7daa8b85e9aa tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:54.483758 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ac08ec25-df3f-4fe1-9499-7daa8b85e9aa tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:54.484483 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ac08ec25-df3f-4fe1-9499-7daa8b85e9aa tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:54.484931 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ac08ec25-df3f-4fe1-9499-7daa8b85e9aa tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:54.485351 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ac08ec25-df3f-4fe1-9499-7daa8b85e9aa tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:54.618019 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ac08ec25-df3f-4fe1-9499-7daa8b85e9aa tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:54.626440 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ac08ec25-df3f-4fe1-9499-7daa8b85e9aa tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1265 microversion: 2.1 time: 0.157189 Sep 15 13:16:54.626995 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 571/1128] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:54 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:16:55.648995 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-5d17caf3-8eb5-4eda-933c-cb3f7d14b23a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:55.649849 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-5d17caf3-8eb5-4eda-933c-cb3f7d14b23a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:55.656121 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5d17caf3-8eb5-4eda-933c-cb3f7d14b23a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:55.656636 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5d17caf3-8eb5-4eda-933c-cb3f7d14b23a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:55.657097 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5d17caf3-8eb5-4eda-933c-cb3f7d14b23a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:55.657785 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5d17caf3-8eb5-4eda-933c-cb3f7d14b23a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:55.658236 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5d17caf3-8eb5-4eda-933c-cb3f7d14b23a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:55.658660 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-5d17caf3-8eb5-4eda-933c-cb3f7d14b23a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:55.791165 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-5d17caf3-8eb5-4eda-933c-cb3f7d14b23a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:55.798844 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-5d17caf3-8eb5-4eda-933c-cb3f7d14b23a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1265 microversion: 2.1 time: 0.153814 Sep 15 13:16:55.799405 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 558/1129] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:55 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:16:56.821860 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d2460811-50e3-4e98-b379-19e6cc0354c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:56.822485 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d2460811-50e3-4e98-b379-19e6cc0354c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:56.829093 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2460811-50e3-4e98-b379-19e6cc0354c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:56.829618 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2460811-50e3-4e98-b379-19e6cc0354c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:56.830050 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2460811-50e3-4e98-b379-19e6cc0354c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:56.831246 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2460811-50e3-4e98-b379-19e6cc0354c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:56.831816 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2460811-50e3-4e98-b379-19e6cc0354c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:56.832249 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d2460811-50e3-4e98-b379-19e6cc0354c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:56.971259 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-d2460811-50e3-4e98-b379-19e6cc0354c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:56.981045 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d2460811-50e3-4e98-b379-19e6cc0354c2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1265 microversion: 2.1 time: 0.163261 Sep 15 13:16:56.981766 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 572/1130] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:56 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:16:57.051422 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-0ca7b9aa-ef55-43ca-889c-00966ed9848b req-1995251b-a11a-4d18-8ce0-f65b36c59f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c320abb-d68d-42e7-90e8-157f80b078d2", "name": "network-vif-plugged", "status": "completed", "tag": "aef7fc17-f173-499b-8e4c-e2499cc7875c"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:16:57.061897 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-0ca7b9aa-ef55-43ca-889c-00966ed9848b req-1995251b-a11a-4d18-8ce0-f65b36c59f96 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:57.062377 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-0ca7b9aa-ef55-43ca-889c-00966ed9848b req-1995251b-a11a-4d18-8ce0-f65b36c59f96 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:57.062812 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-0ca7b9aa-ef55-43ca-889c-00966ed9848b req-1995251b-a11a-4d18-8ce0-f65b36c59f96 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:57.074204 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-0ca7b9aa-ef55-43ca-889c-00966ed9848b req-1995251b-a11a-4d18-8ce0-f65b36c59f96 service nova] Creating event network-vif-plugged:aef7fc17-f173-499b-8e4c-e2499cc7875c for instance 9c320abb-d68d-42e7-90e8-157f80b078d2 on hv-cinder-83608 Sep 15 13:16:57.079230 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-0ca7b9aa-ef55-43ca-889c-00966ed9848b req-1995251b-a11a-4d18-8ce0-f65b36c59f96 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135764 Sep 15 13:16:57.079993 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 559/1131] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:16:58.005256 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-775f1a29-044a-48cf-971f-bfad47195455 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:58.005894 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-775f1a29-044a-48cf-971f-bfad47195455 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:58.013032 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-775f1a29-044a-48cf-971f-bfad47195455 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:58.013511 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-775f1a29-044a-48cf-971f-bfad47195455 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:58.013938 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-775f1a29-044a-48cf-971f-bfad47195455 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:58.014623 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-775f1a29-044a-48cf-971f-bfad47195455 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:58.015068 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-775f1a29-044a-48cf-971f-bfad47195455 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:58.015484 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-775f1a29-044a-48cf-971f-bfad47195455 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:58.150321 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-775f1a29-044a-48cf-971f-bfad47195455 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:58.157990 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-775f1a29-044a-48cf-971f-bfad47195455 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1265 microversion: 2.1 time: 0.156664 Sep 15 13:16:58.158555 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 573/1132] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:58 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:16:59.182005 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a5ac775d-41aa-4c2d-b3a9-612576979b29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:59.182734 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a5ac775d-41aa-4c2d-b3a9-612576979b29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:59.189061 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a5ac775d-41aa-4c2d-b3a9-612576979b29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:59.189542 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a5ac775d-41aa-4c2d-b3a9-612576979b29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:59.189972 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a5ac775d-41aa-4c2d-b3a9-612576979b29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:59.190698 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a5ac775d-41aa-4c2d-b3a9-612576979b29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:59.191146 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a5ac775d-41aa-4c2d-b3a9-612576979b29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:59.191564 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a5ac775d-41aa-4c2d-b3a9-612576979b29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:59.327828 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a5ac775d-41aa-4c2d-b3a9-612576979b29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:59.335675 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a5ac775d-41aa-4c2d-b3a9-612576979b29 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1452 microversion: 2.1 time: 0.158359 Sep 15 13:16:59.336228 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 560/1133] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:59 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:16:59.357808 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-ab5bbbfe-64a7-4d50-8558-a302e270dbf9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:16:59.358351 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-ab5bbbfe-64a7-4d50-8558-a302e270dbf9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:16:59.364649 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab5bbbfe-64a7-4d50-8558-a302e270dbf9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:59.365129 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab5bbbfe-64a7-4d50-8558-a302e270dbf9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:59.365554 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab5bbbfe-64a7-4d50-8558-a302e270dbf9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:59.366233 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab5bbbfe-64a7-4d50-8558-a302e270dbf9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:16:59.367241 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab5bbbfe-64a7-4d50-8558-a302e270dbf9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:16:59.367657 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-ab5bbbfe-64a7-4d50-8558-a302e270dbf9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:16:59.497455 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-ab5bbbfe-64a7-4d50-8558-a302e270dbf9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:16:59.505223 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-ab5bbbfe-64a7-4d50-8558-a302e270dbf9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1452 microversion: 2.1 time: 0.151264 Sep 15 13:16:59.505792 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 574/1134] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:16:59 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:17:01.448966 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-2cbd647d-ace4-4a7f-a538-aadd1af91a23 req-9a9278c8-b398-42c4-b0bc-b6cf9f5b63d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c320abb-d68d-42e7-90e8-157f80b078d2", "tag": "aef7fc17-f173-499b-8e4c-e2499cc7875c"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:17:01.458427 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-2cbd647d-ace4-4a7f-a538-aadd1af91a23 req-9a9278c8-b398-42c4-b0bc-b6cf9f5b63d2 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:17:01.458883 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-2cbd647d-ace4-4a7f-a538-aadd1af91a23 req-9a9278c8-b398-42c4-b0bc-b6cf9f5b63d2 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:17:01.459315 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-2cbd647d-ace4-4a7f-a538-aadd1af91a23 req-9a9278c8-b398-42c4-b0bc-b6cf9f5b63d2 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:17:01.470775 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-2cbd647d-ace4-4a7f-a538-aadd1af91a23 req-9a9278c8-b398-42c4-b0bc-b6cf9f5b63d2 service nova] Creating event network-changed:aef7fc17-f173-499b-8e4c-e2499cc7875c for instance 9c320abb-d68d-42e7-90e8-157f80b078d2 on hv-cinder-83608 Sep 15 13:17:01.475819 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-2cbd647d-ace4-4a7f-a538-aadd1af91a23 req-9a9278c8-b398-42c4-b0bc-b6cf9f5b63d2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084113 Sep 15 13:17:01.477350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 561/1135] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:18:50.984147 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:18:50.985264 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG dbcounter [-] [120633] Writing DB stats nova_cell1:SELECT=52 {{(pid=120633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:18:50.987724 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_api:SELECT=22 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:18:50.988748 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG dbcounter [-] [120634] Writing DB stats nova_cell1:SELECT=46 {{(pid=120634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:18:50.989942 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 13:18:50.990086 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Thu Sep 15 13:18:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.57) !!! Sep 15 13:18:50.990374 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-d49db013-a91a-4eab-9de7-6c022f406257 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:18:50.990858 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d49db013-a91a-4eab-9de7-6c022f406257 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:18:50.993332 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 13:18:50.993464 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Thu Sep 15 13:18:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.57) !!! Sep 15 13:18:51.001823 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d49db013-a91a-4eab-9de7-6c022f406257 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:51.002318 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d49db013-a91a-4eab-9de7-6c022f406257 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:51.002755 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d49db013-a91a-4eab-9de7-6c022f406257 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:51.003457 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d49db013-a91a-4eab-9de7-6c022f406257 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:51.003928 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d49db013-a91a-4eab-9de7-6c022f406257 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:51.004583 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-d49db013-a91a-4eab-9de7-6c022f406257 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:51.013303 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-1db3d269-cef8-4e66-9f64-8b1a2b740444 req-1d86159e-91ec-47c1-b577-50db9bc194d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c320abb-d68d-42e7-90e8-157f80b078d2", "tag": "aef7fc17-f173-499b-8e4c-e2499cc7875c"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:18:51.024765 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-1db3d269-cef8-4e66-9f64-8b1a2b740444 req-1d86159e-91ec-47c1-b577-50db9bc194d6 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:51.025520 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-1db3d269-cef8-4e66-9f64-8b1a2b740444 req-1d86159e-91ec-47c1-b577-50db9bc194d6 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:51.025951 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-1db3d269-cef8-4e66-9f64-8b1a2b740444 req-1d86159e-91ec-47c1-b577-50db9bc194d6 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:51.031260 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-d49db013-a91a-4eab-9de7-6c022f406257 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Going to try to terminate instance {{(pid=120633) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:18:51.036738 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-1db3d269-cef8-4e66-9f64-8b1a2b740444 req-1d86159e-91ec-47c1-b577-50db9bc194d6 service nova] Creating event network-changed:aef7fc17-f173-499b-8e4c-e2499cc7875c for instance 9c320abb-d68d-42e7-90e8-157f80b078d2 on hv-cinder-83608 Sep 15 13:18:51.042645 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-1db3d269-cef8-4e66-9f64-8b1a2b740444 req-1d86159e-91ec-47c1-b577-50db9bc194d6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057759 Sep 15 13:18:51.043596 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 562/1136] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:18:51.122950 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-d49db013-a91a-4eab-9de7-6c022f406257 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 204 len: 0 microversion: 2.1 time: 0.140741 Sep 15 13:18:51.123840 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 575/1137] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:18:50 2022] DELETE /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:18:51.134410 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a0532afa-cbda-4ff3-972a-2b0834c9a4a9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:18:51.135133 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a0532afa-cbda-4ff3-972a-2b0834c9a4a9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:18:51.142682 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0532afa-cbda-4ff3-972a-2b0834c9a4a9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:51.142876 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0532afa-cbda-4ff3-972a-2b0834c9a4a9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:51.143220 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0532afa-cbda-4ff3-972a-2b0834c9a4a9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:51.143923 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0532afa-cbda-4ff3-972a-2b0834c9a4a9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:51.145530 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0532afa-cbda-4ff3-972a-2b0834c9a4a9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:51.145530 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a0532afa-cbda-4ff3-972a-2b0834c9a4a9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:51.283808 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-a0532afa-cbda-4ff3-972a-2b0834c9a4a9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:18:51.292519 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a0532afa-cbda-4ff3-972a-2b0834c9a4a9 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1577 microversion: 2.1 time: 0.164106 Sep 15 13:18:51.293095 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 563/1138] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:18:51 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:18:52.317261 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-f142b0f7-647c-4f63-8d07-42535f1300d6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:18:52.317957 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-f142b0f7-647c-4f63-8d07-42535f1300d6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:18:52.324811 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f142b0f7-647c-4f63-8d07-42535f1300d6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:52.325293 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f142b0f7-647c-4f63-8d07-42535f1300d6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:52.325726 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f142b0f7-647c-4f63-8d07-42535f1300d6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:52.326412 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f142b0f7-647c-4f63-8d07-42535f1300d6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:52.326860 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f142b0f7-647c-4f63-8d07-42535f1300d6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:52.327348 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-f142b0f7-647c-4f63-8d07-42535f1300d6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:52.460176 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-f142b0f7-647c-4f63-8d07-42535f1300d6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:18:52.467942 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-f142b0f7-647c-4f63-8d07-42535f1300d6 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1577 microversion: 2.1 time: 0.155065 Sep 15 13:18:52.468525 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 576/1139] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:18:52 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:18:53.477947 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-a5b01801-941e-4c8e-9a9a-f35854600085 req-dc4c4cc4-3846-40cd-a85a-da41fde64447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c320abb-d68d-42e7-90e8-157f80b078d2", "name": "network-vif-deleted", "tag": "aef7fc17-f173-499b-8e4c-e2499cc7875c"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:18:53.487359 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-a5b01801-941e-4c8e-9a9a-f35854600085 req-dc4c4cc4-3846-40cd-a85a-da41fde64447 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:53.487778 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-a5b01801-941e-4c8e-9a9a-f35854600085 req-dc4c4cc4-3846-40cd-a85a-da41fde64447 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:53.488211 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-a5b01801-941e-4c8e-9a9a-f35854600085 req-dc4c4cc4-3846-40cd-a85a-da41fde64447 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:53.492593 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-6373d238-6723-423b-838f-15ccaa7a682d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:18:53.493404 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-6373d238-6723-423b-838f-15ccaa7a682d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:18:53.499830 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6373d238-6723-423b-838f-15ccaa7a682d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:53.500352 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6373d238-6723-423b-838f-15ccaa7a682d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:53.500787 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6373d238-6723-423b-838f-15ccaa7a682d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:53.501529 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6373d238-6723-423b-838f-15ccaa7a682d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:53.502516 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6373d238-6723-423b-838f-15ccaa7a682d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:53.503091 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-6373d238-6723-423b-838f-15ccaa7a682d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:53.503984 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-a5b01801-941e-4c8e-9a9a-f35854600085 req-dc4c4cc4-3846-40cd-a85a-da41fde64447 service nova] Creating event network-vif-deleted:aef7fc17-f173-499b-8e4c-e2499cc7875c for instance 9c320abb-d68d-42e7-90e8-157f80b078d2 on hv-cinder-83608 Sep 15 13:18:53.509902 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-a5b01801-941e-4c8e-9a9a-f35854600085 req-dc4c4cc4-3846-40cd-a85a-da41fde64447 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035927 Sep 15 13:18:53.510804 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 564/1140] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:18:53.571566 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-6373d238-6723-423b-838f-15ccaa7a682d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:18:53.580071 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-6373d238-6723-423b-838f-15ccaa7a682d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 200 len: 1224 microversion: 2.1 time: 0.092818 Sep 15 13:18:53.580771 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 577/1141] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:18:53 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:18:54.605485 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-43ca1096-ea74-4cd6-8657-798bfc4dbdc0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:18:54.606127 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-43ca1096-ea74-4cd6-8657-798bfc4dbdc0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 9c320abb-d68d-42e7-90e8-157f80b078d2] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:18:54.612329 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-43ca1096-ea74-4cd6-8657-798bfc4dbdc0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:54.612815 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-43ca1096-ea74-4cd6-8657-798bfc4dbdc0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:54.613250 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-43ca1096-ea74-4cd6-8657-798bfc4dbdc0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:54.613937 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-43ca1096-ea74-4cd6-8657-798bfc4dbdc0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:54.614387 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-43ca1096-ea74-4cd6-8657-798bfc4dbdc0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:54.614807 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-43ca1096-ea74-4cd6-8657-798bfc4dbdc0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:54.630326 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-43ca1096-ea74-4cd6-8657-798bfc4dbdc0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] HTTP exception thrown: Instance 9c320abb-d68d-42e7-90e8-157f80b078d2 could not be found. Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-43ca1096-ea74-4cd6-8657-798bfc4dbdc0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Request method failure captured: Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 HTTP/1.1 Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyRMUVNlLRRtwwB9SaJ5mowtx-Rg-ErQ6MovWaRc0yjHvO0_c-uH8sXsZHtHF86ve6FGWjlpZe0NOo-9apr8wFLdzKJd83lB0Z1Tp9tk2ZPeqHacORgslE3uBd2ypc0bCu9YH_yR9QuF298m_ngk5NmivI01k4kaWBlGI53uo7ejN8k Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 1344373f29a44b7c8db2f9bab5f38467 Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:18:54.631970 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:18:54.633867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1344373f29a44b7c8db2f9bab5f38467", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1344373f29a44b7c8db2f9bab5f38467"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1344373f29a44b7c8db2f9bab5f38467"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1344373f29a44b7c8db2f9bab5f38467"}]}] Sep 15 13:18:54.633867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:18:54.633867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 1344373f29a44b7c8db2f9bab5f38467 Sep 15 13:18:54.633867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:18:54.633867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-TestVolumeBootPattern-1560206344-project Sep 15 13:18:54.633867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:18:54.633867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:18:54.633867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: 3c50430b23404745ab4c1099bf12d4f5 Sep 15 13:18:54.633867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-TestVolumeBootPattern-1560206344-project Sep 15 13:18:54.633867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:18:54.633867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance 9c320abb-d68d-42e7-90e8-157f80b078d2 could not be found. Sep 15 13:18:54.633867 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': '9c320abb-d68d-42e7-90e8-157f80b078d2'} Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c320abb-d68d-42e7-90e8-157f80b078d2 could not be found. Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:18:54.635072 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c320abb-d68d-42e7-90e8-157f80b078d2 could not be found. Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c320abb-d68d-42e7-90e8-157f80b078d2 could not be found. Sep 15 13:18:54.636859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:18:54.638420 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-43ca1096-ea74-4cd6-8657-798bfc4dbdc0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Returning 404 to user: Instance 9c320abb-d68d-42e7-90e8-157f80b078d2 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:18:54.638420 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-43ca1096-ea74-4cd6-8657-798bfc4dbdc0 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2" status: 404 len: 111 microversion: 2.1 time: 0.033628 Sep 15 13:18:54.638420 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 565/1142] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:18:54 2022] GET /compute/v2.1/servers/9c320abb-d68d-42e7-90e8-157f80b078d2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:18:57.702019 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b373afbd-82a6-4a92-9eba-99211e8c18bf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:18:57.702503 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b373afbd-82a6-4a92-9eba-99211e8c18bf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:18:57.704822 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-d865fec4-f36f-4fbc-993d-82c2f63c6c28 req-a1b7b0dc-0376-46a8-85ca-d6adde7750b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26b9d622-cc02-41bb-be21-da138c80ba36", "tag": "5f2b06e0-044d-47fc-9990-00ba28ee8a35"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:18:57.709338 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b373afbd-82a6-4a92-9eba-99211e8c18bf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:57.710059 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b373afbd-82a6-4a92-9eba-99211e8c18bf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:57.710818 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b373afbd-82a6-4a92-9eba-99211e8c18bf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:57.711548 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b373afbd-82a6-4a92-9eba-99211e8c18bf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:57.712224 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b373afbd-82a6-4a92-9eba-99211e8c18bf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:57.712664 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b373afbd-82a6-4a92-9eba-99211e8c18bf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:57.715604 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-d865fec4-f36f-4fbc-993d-82c2f63c6c28 req-a1b7b0dc-0376-46a8-85ca-d6adde7750b2 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:57.716159 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-d865fec4-f36f-4fbc-993d-82c2f63c6c28 req-a1b7b0dc-0376-46a8-85ca-d6adde7750b2 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:57.716836 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-d865fec4-f36f-4fbc-993d-82c2f63c6c28 req-a1b7b0dc-0376-46a8-85ca-d6adde7750b2 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:57.728647 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-d865fec4-f36f-4fbc-993d-82c2f63c6c28 req-a1b7b0dc-0376-46a8-85ca-d6adde7750b2 service nova] Creating event network-changed:5f2b06e0-044d-47fc-9990-00ba28ee8a35 for instance 26b9d622-cc02-41bb-be21-da138c80ba36 on hv-cinder-83608 Sep 15 13:18:57.733923 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-d865fec4-f36f-4fbc-993d-82c2f63c6c28 req-a1b7b0dc-0376-46a8-85ca-d6adde7750b2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032709 Sep 15 13:18:57.734924 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 566/1143] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:18:57.738570 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b373afbd-82a6-4a92-9eba-99211e8c18bf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Going to try to terminate instance {{(pid=120633) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 13:18:57.829541 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b373afbd-82a6-4a92-9eba-99211e8c18bf tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 204 len: 0 microversion: 2.1 time: 0.131115 Sep 15 13:18:57.830519 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 578/1144] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:18:57 2022] DELETE /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 13:18:57.839369 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-00e3767d-c60f-4e66-b71e-6903be93428a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:18:57.840088 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-00e3767d-c60f-4e66-b71e-6903be93428a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:18:57.849098 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-00e3767d-c60f-4e66-b71e-6903be93428a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:57.849600 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-00e3767d-c60f-4e66-b71e-6903be93428a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:57.850041 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-00e3767d-c60f-4e66-b71e-6903be93428a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:57.851294 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-00e3767d-c60f-4e66-b71e-6903be93428a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:57.851756 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-00e3767d-c60f-4e66-b71e-6903be93428a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:57.852188 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-00e3767d-c60f-4e66-b71e-6903be93428a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:58.035091 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.policy [None req-00e3767d-c60f-4e66-b71e-6903be93428a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120634) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:18:58.044132 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-00e3767d-c60f-4e66-b71e-6903be93428a tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1578 microversion: 2.1 time: 0.208878 Sep 15 13:18:58.045024 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 567/1145] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:18:57 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1578 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 13:18:59.068838 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b5308d2e-23a5-4f25-aad3-20d91b142ed2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:18:59.069539 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-b5308d2e-23a5-4f25-aad3-20d91b142ed2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:18:59.075858 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b5308d2e-23a5-4f25-aad3-20d91b142ed2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:59.076360 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b5308d2e-23a5-4f25-aad3-20d91b142ed2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:59.076795 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b5308d2e-23a5-4f25-aad3-20d91b142ed2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:59.077482 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b5308d2e-23a5-4f25-aad3-20d91b142ed2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:18:59.077928 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b5308d2e-23a5-4f25-aad3-20d91b142ed2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:18:59.078347 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-b5308d2e-23a5-4f25-aad3-20d91b142ed2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:18:59.218014 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-b5308d2e-23a5-4f25-aad3-20d91b142ed2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:18:59.226367 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b5308d2e-23a5-4f25-aad3-20d91b142ed2 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1578 microversion: 2.1 time: 0.161837 Sep 15 13:18:59.226935 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 579/1146] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:18:59 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:19:00.022944 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [req-dbe4d58a-1f7b-4302-9e37-72124daa8970 req-adfe2572-f154-49b6-a19f-0e1ef2275851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b9d622-cc02-41bb-be21-da138c80ba36", "name": "network-vif-deleted", "tag": "5f2b06e0-044d-47fc-9990-00ba28ee8a35"}]} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 13:19:00.033170 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-dbe4d58a-1f7b-4302-9e37-72124daa8970 req-adfe2572-f154-49b6-a19f-0e1ef2275851 service nova] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:19:00.033650 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-dbe4d58a-1f7b-4302-9e37-72124daa8970 req-adfe2572-f154-49b6-a19f-0e1ef2275851 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:19:00.034113 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [req-dbe4d58a-1f7b-4302-9e37-72124daa8970 req-adfe2572-f154-49b6-a19f-0e1ef2275851 service nova] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:19:00.046921 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.compute.server_external_events [req-dbe4d58a-1f7b-4302-9e37-72124daa8970 req-adfe2572-f154-49b6-a19f-0e1ef2275851 service nova] Creating event network-vif-deleted:5f2b06e0-044d-47fc-9990-00ba28ee8a35 for instance 26b9d622-cc02-41bb-be21-da138c80ba36 on hv-cinder-83608 Sep 15 13:19:00.051879 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [req-dbe4d58a-1f7b-4302-9e37-72124daa8970 req-adfe2572-f154-49b6-a19f-0e1ef2275851 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032700 Sep 15 13:19:00.052517 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 568/1147] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Sep 15 13:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 13:19:00.250089 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-21ffcfef-9e58-4f20-a3d0-a1925e8b9ffc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:19:00.250662 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-21ffcfef-9e58-4f20-a3d0-a1925e8b9ffc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:19:00.257342 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-21ffcfef-9e58-4f20-a3d0-a1925e8b9ffc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:19:00.257821 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-21ffcfef-9e58-4f20-a3d0-a1925e8b9ffc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:19:00.258249 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-21ffcfef-9e58-4f20-a3d0-a1925e8b9ffc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:19:00.258936 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-21ffcfef-9e58-4f20-a3d0-a1925e8b9ffc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:19:00.259383 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-21ffcfef-9e58-4f20-a3d0-a1925e8b9ffc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:19:00.259797 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-21ffcfef-9e58-4f20-a3d0-a1925e8b9ffc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:19:00.326022 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.policy [None req-21ffcfef-9e58-4f20-a3d0-a1925e8b9ffc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c50430b23404745ab4c1099bf12d4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344373f29a44b7c8db2f9bab5f38467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120633) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 13:19:00.334449 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-21ffcfef-9e58-4f20-a3d0-a1925e8b9ffc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 200 len: 1225 microversion: 2.1 time: 0.088211 Sep 15 13:19:00.335033 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 580/1148] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:19:00 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 13:19:01.358791 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a17fbf22-6251-4a98-907c-de8cfe53acfc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:19:01.359419 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-a17fbf22-6251-4a98-907c-de8cfe53acfc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: 26b9d622-cc02-41bb-be21-da138c80ba36] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:19:01.365532 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a17fbf22-6251-4a98-907c-de8cfe53acfc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:19:01.366523 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a17fbf22-6251-4a98-907c-de8cfe53acfc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:19:01.366961 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a17fbf22-6251-4a98-907c-de8cfe53acfc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:19:01.367644 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a17fbf22-6251-4a98-907c-de8cfe53acfc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:19:01.368100 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a17fbf22-6251-4a98-907c-de8cfe53acfc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:19:01.368556 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-a17fbf22-6251-4a98-907c-de8cfe53acfc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:19:01.382181 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-a17fbf22-6251-4a98-907c-de8cfe53acfc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] HTTP exception thrown: Instance 26b9d622-cc02-41bb-be21-da138c80ba36 could not be found. Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a17fbf22-6251-4a98-907c-de8cfe53acfc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Request method failure captured: Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 HTTP/1.1 Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyRMUVNlLRRtwwB9SaJ5mowtx-Rg-ErQ6MovWaRc0yjHvO0_c-uH8sXsZHtHF86ve6FGWjlpZe0NOo-9apr8wFLdzKJd83lB0Z1Tp9tk2ZPeqHacORgslE3uBd2ypc0bCu9YH_yR9QuF298m_ngk5NmivI01k4kaWBlGI53uo7ejN8k Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 1344373f29a44b7c8db2f9bab5f38467 Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:19:01.383783 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:19:01.385683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1344373f29a44b7c8db2f9bab5f38467", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1344373f29a44b7c8db2f9bab5f38467"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1344373f29a44b7c8db2f9bab5f38467"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1344373f29a44b7c8db2f9bab5f38467"}]}] Sep 15 13:19:01.385683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:19:01.385683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 1344373f29a44b7c8db2f9bab5f38467 Sep 15 13:19:01.385683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:19:01.385683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-TestVolumeBootPattern-1560206344-project Sep 15 13:19:01.385683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:19:01.385683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:19:01.385683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: 3c50430b23404745ab4c1099bf12d4f5 Sep 15 13:19:01.385683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-TestVolumeBootPattern-1560206344-project Sep 15 13:19:01.385683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:19:01.385683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance 26b9d622-cc02-41bb-be21-da138c80ba36 could not be found. Sep 15 13:19:01.385683 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': '26b9d622-cc02-41bb-be21-da138c80ba36'} Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26b9d622-cc02-41bb-be21-da138c80ba36 could not be found. Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:19:01.386685 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26b9d622-cc02-41bb-be21-da138c80ba36 could not be found. Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26b9d622-cc02-41bb-be21-da138c80ba36 could not be found. Sep 15 13:19:01.388350 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.389962 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-a17fbf22-6251-4a98-907c-de8cfe53acfc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Returning 404 to user: Instance 26b9d622-cc02-41bb-be21-da138c80ba36 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:19:01.389962 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-a17fbf22-6251-4a98-907c-de8cfe53acfc tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36" status: 404 len: 111 microversion: 2.1 time: 0.031370 Sep 15 13:19:01.389962 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 569/1149] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:19:01 2022] GET /compute/v2.1/servers/26b9d622-cc02-41bb-be21-da138c80ba36 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:19:01.811989 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2bb3a8ab-8f5b-452b-9409-ac315fc44b4d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:19:01.812546 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.compute.api [None req-2bb3a8ab-8f5b-452b-9409-ac315fc44b4d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120633) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:19:01.819740 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2bb3a8ab-8f5b-452b-9409-ac315fc44b4d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:19:01.820226 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2bb3a8ab-8f5b-452b-9409-ac315fc44b4d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:19:01.820683 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2bb3a8ab-8f5b-452b-9409-ac315fc44b4d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:19:01.821371 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2bb3a8ab-8f5b-452b-9409-ac315fc44b4d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:19:01.821819 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2bb3a8ab-8f5b-452b-9409-ac315fc44b4d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:19:01.822236 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-2bb3a8ab-8f5b-452b-9409-ac315fc44b4d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:19:01.836305 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-2bb3a8ab-8f5b-452b-9409-ac315fc44b4d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] HTTP exception thrown: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2bb3a8ab-8f5b-452b-9409-ac315fc44b4d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Request method failure captured: Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: request: DELETE /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 HTTP/1.1 Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept: application/json Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Accept-Encoding: identity Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Connection: close Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Length: 0 Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Content-Type: application/json Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Host: 10.222.0.57 Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: Openstack-System-Scope: None Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: User-Agent: python-urllib3/1.26.12 Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Auth-Token: gAAAAABjIyRMUVNlLRRtwwB9SaJ5mowtx-Rg-ErQ6MovWaRc0yjHvO0_c-uH8sXsZHtHF86ve6FGWjlpZe0NOo-9apr8wFLdzKJd83lB0Z1Tp9tk2ZPeqHacORgslE3uBd2ypc0bCu9YH_yR9QuF298m_ngk5NmivI01k4kaWBlGI53uo7ejN8k Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Id: None Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Domain-Name: None Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Identity-Status: Confirmed Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Is-Admin-Project: True Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Id: default Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Domain-Name: Default Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Id: 1344373f29a44b7c8db2f9bab5f38467 Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Project-Name: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Role: member,reader Sep 15 13:19:01.837952 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Roles: member,reader Sep 15 13:19:01.840922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1344373f29a44b7c8db2f9bab5f38467", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1344373f29a44b7c8db2f9bab5f38467"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1344373f29a44b7c8db2f9bab5f38467"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1344373f29a44b7c8db2f9bab5f38467"}]}] Sep 15 13:19:01.840922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:19:01.840922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Id: 1344373f29a44b7c8db2f9bab5f38467 Sep 15 13:19:01.840922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:19:01.840922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User: tempest-TestVolumeBootPattern-1560206344-project Sep 15 13:19:01.840922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Id: default Sep 15 13:19:01.840922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Domain-Name: Default Sep 15 13:19:01.840922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Id: 3c50430b23404745ab4c1099bf12d4f5 Sep 15 13:19:01.840922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: X-User-Name: tempest-TestVolumeBootPattern-1560206344-project Sep 15 13:19:01.840922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: method: > Sep 15 13:19:01.840922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: exception: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:19:01.840922 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: action_args: {'id': 'b1f2714f-b4cf-431b-b172-22bb4feb5e27'} Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:19:01.842439 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:19:01.844913 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.847827 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-2bb3a8ab-8f5b-452b-9409-ac315fc44b4d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Returning 404 to user: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:19:01.847827 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-2bb3a8ab-8f5b-452b-9409-ac315fc44b4d tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 404 len: 111 microversion: 2.1 time: 0.031208 Sep 15 13:19:01.847827 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 581/1150] 10.222.0.57 () {58 vars in 1239 bytes} [Thu Sep 15 13:19:01 2022] DELETE /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:19:01.848247 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2bdb0162-7706-439d-a0dd-d15651bc60e8 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:19:01.849591 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.compute.api [None req-2bdb0162-7706-439d-a0dd-d15651bc60e8 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] [instance: b1f2714f-b4cf-431b-b172-22bb4feb5e27] Fetching instance by UUID {{(pid=120634) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 13:19:01.854954 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bdb0162-7706-439d-a0dd-d15651bc60e8 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:19:01.855446 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bdb0162-7706-439d-a0dd-d15651bc60e8 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:19:01.855887 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bdb0162-7706-439d-a0dd-d15651bc60e8 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:19:01.856621 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bdb0162-7706-439d-a0dd-d15651bc60e8 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Acquiring lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 13:19:01.857078 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bdb0162-7706-439d-a0dd-d15651bc60e8 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 13:19:01.857510 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-2bdb0162-7706-439d-a0dd-d15651bc60e8 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Lock "6795f125-b3e5-4c74-8d4a-d8548f3dc3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 13:19:01.874859 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-2bdb0162-7706-439d-a0dd-d15651bc60e8 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] HTTP exception thrown: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2bdb0162-7706-439d-a0dd-d15651bc60e8 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Request method failure captured: Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: request: GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 HTTP/1.1 Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept: application/json Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Accept-Encoding: identity Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Connection: close Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Length: 0 Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Content-Type: application/json Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Host: 10.222.0.57 Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: Openstack-System-Scope: None Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: User-Agent: python-urllib3/1.26.12 Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Auth-Token: gAAAAABjIyRMUVNlLRRtwwB9SaJ5mowtx-Rg-ErQ6MovWaRc0yjHvO0_c-uH8sXsZHtHF86ve6FGWjlpZe0NOo-9apr8wFLdzKJd83lB0Z1Tp9tk2ZPeqHacORgslE3uBd2ypc0bCu9YH_yR9QuF298m_ngk5NmivI01k4kaWBlGI53uo7ejN8k Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Id: None Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Domain-Name: None Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Identity-Status: Confirmed Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Is-Admin-Project: True Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Id: default Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Domain-Name: Default Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Id: 1344373f29a44b7c8db2f9bab5f38467 Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Project-Name: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Role: member,reader Sep 15 13:19:01.876434 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Roles: member,reader Sep 15 13:19:01.878139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1344373f29a44b7c8db2f9bab5f38467", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1344373f29a44b7c8db2f9bab5f38467"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1344373f29a44b7c8db2f9bab5f38467"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1344373f29a44b7c8db2f9bab5f38467"}]}] Sep 15 13:19:01.878139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:19:01.878139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Id: 1344373f29a44b7c8db2f9bab5f38467 Sep 15 13:19:01.878139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560206344 Sep 15 13:19:01.878139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User: tempest-TestVolumeBootPattern-1560206344-project Sep 15 13:19:01.878139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Id: default Sep 15 13:19:01.878139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Domain-Name: Default Sep 15 13:19:01.878139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Id: 3c50430b23404745ab4c1099bf12d4f5 Sep 15 13:19:01.878139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: X-User-Name: tempest-TestVolumeBootPattern-1560206344-project Sep 15 13:19:01.878139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: method: > Sep 15 13:19:01.878139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: exception: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:19:01.878139 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: action_args: {'id': 'b1f2714f-b4cf-431b-b172-22bb4feb5e27'} Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 13:19:01.879175 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. Sep 15 13:19:01.880823 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: ERROR nova.api.openstack.wsgi Sep 15 13:19:01.883243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2bdb0162-7706-439d-a0dd-d15651bc60e8 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Returning 404 to user: Instance b1f2714f-b4cf-431b-b172-22bb4feb5e27 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 13:19:01.883243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2bdb0162-7706-439d-a0dd-d15651bc60e8 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27" status: 404 len: 111 microversion: 2.1 time: 0.033739 Sep 15 13:19:01.883243 dv-cinder-836083-13-iscsi devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 570/1151] 10.222.0.57 () {58 vars in 1236 bytes} [Thu Sep 15 13:19:01 2022] GET /compute/v2.1/servers/b1f2714f-b4cf-431b-b172-22bb4feb5e27 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 13:19:03.446619 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b3295060-84b6-467a-8d9a-434a80ebecc8 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] Calling method '.version_select at 0x7f62c552c670>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 13:19:03.479714 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b3295060-84b6-467a-8d9a-434a80ebecc8 tempest-TestVolumeBootPattern-1560206344 tempest-TestVolumeBootPattern-1560206344-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-637497301" status: 202 len: 0 microversion: 2.1 time: 0.037285 Sep 15 13:19:03.480350 dv-cinder-836083-13-iscsi devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 582/1152] 10.222.0.57 () {58 vars in 1260 bytes} [Thu Sep 15 13:19:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-637497301 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)